-- Logs begin at Wed 2021-11-24 17:25:49 UTC, end at Wed 2021-11-24 19:04:13 UTC. -- Nov 24 18:07:06.371631 dv-cinder-804035-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 18:07:06.381578 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 18:07:06 2021] *** Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: nodename: dv-cinder-804035-22-iscsi Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: machine: x86_64 Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: clock source: unix Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: pcre jit disabled Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: detected number of CPU cores: 4 Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: current working directory: / Nov 24 18:07:06.383039 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: detected binary path: /usr/bin/uwsgi-core Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: your processes number limit is 47680 Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: your memory page size is 4096 bytes Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: detected max file descriptor number: 2048 Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: lock engine: pthread robust mutexes Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: thunder lock: enabled Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 18:07:06.383819 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 18:07:06.429820 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: Python main interpreter initialized at 0x560ed0bd79c0 Nov 24 18:07:06.429820 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: python threads support enabled Nov 24 18:07:06.429820 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: your server socket listen backlog is limited to 100 connections Nov 24 18:07:06.429820 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: your mercy for graceful operations on workers is 90 seconds Nov 24 18:07:06.430192 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 18:07:06.430287 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: *** Operational MODE: preforking *** Nov 24 18:07:06.430490 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: *** uWSGI is running in multiple interpreter mode *** Nov 24 18:07:06.430490 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: spawned uWSGI master process (pid: 102516) Nov 24 18:07:06.430682 dv-cinder-804035-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 18:07:06.432316 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: spawned uWSGI worker 1 (pid: 102517, cores: 1) Nov 24 18:07:06.432316 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: spawned uWSGI worker 2 (pid: 102518, cores: 1) Nov 24 18:07:06.432316 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 18:07:08.027555 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:07:08.027555 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: from cryptography.utils import int_from_bytes Nov 24 18:07:08.028235 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:07:08.028235 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: from cryptography.utils import int_from_bytes Nov 24 18:07:08.032447 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:07:08.032447 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: from cryptography.utils import int_from_bytes Nov 24 18:07:08.032947 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:07:08.032947 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: from cryptography.utils import int_from_bytes Nov 24 18:07:10.509019 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 18:07:10.509590 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 18:07:10.509780 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 18:07:10.510137 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 18:07:10.510389 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 18:07:10.510774 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 18:07:10.511174 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.511247 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 18:07:10.511330 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.511398 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.511546 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 18:07:10.511703 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.511883 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 18:07:10.512030 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.512127 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 18:07:10.512339 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.512514 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.512659 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.512844 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.512978 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513167 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513305 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513488 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513575 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513846 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.513987 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514165 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514282 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-22-iscsi {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514496 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514589 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514801 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.514890 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515111 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515212 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515384 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515490 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515700 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.515788 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516028 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-22-iscsi {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516127 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516331 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516428 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516652 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516828 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.516966 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.517265 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.517364 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.517574 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.517666 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.517909 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.518011 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.518235 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.518327 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.518551 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.518766 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.519516 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.519724 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.519922 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.520123 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.520347 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.520541 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.520725 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.520916 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.521123 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.521318 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.521318 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.521672 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-22-iscsi {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.521884 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522016 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522163 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522278 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522432 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522549 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522706 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522860 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.522976 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-22-iscsi {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523098 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523260 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523360 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523576 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523682 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523895 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.523993 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.524227 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.524379 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.524558 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.524727 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.524876 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525017 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525187 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525339 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525510 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525653 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525843 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.525988 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526162 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526298 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526454 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526606 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526744 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.526880 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527017 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527153 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527327 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527483 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527627 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527776 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.527912 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528047 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528184 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528334 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528471 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528612 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528817 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.528960 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529104 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529245 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529387 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529536 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529671 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529835 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.529988 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530127 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530262 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530405 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530550 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530699 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530843 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.530980 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531134 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531283 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531421 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531564 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531702 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531846 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.531989 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532131 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532279 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532417 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532552 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532688 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532839 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.532976 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533120 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533263 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533418 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533645 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533808 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.533950 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.534137 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.534281 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.534460 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.534656 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535199 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535359 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535515 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535655 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535798 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.535935 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536078 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536215 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536360 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536511 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536649 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536784 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.536919 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537062 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537211 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537348 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537483 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537620 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537793 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.537949 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538087 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538233 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538370 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538370 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538628 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538772 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.538908 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539061 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539197 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539332 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539467 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539611 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539755 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.539891 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540026 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540167 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540311 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540448 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540583 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540736 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.540872 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541013 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541157 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541293 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541428 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541563 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541698 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.541897 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542052 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542191 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542327 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542492 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542732 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.542874 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543021 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543165 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543309 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543445 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543581 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543812 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.543966 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544105 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544242 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544378 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544514 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544668 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544812 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.544951 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545099 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545236 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545371 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545507 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545654 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545844 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.545989 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546125 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546285 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546432 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546585 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546723 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.546859 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547008 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547147 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547290 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547427 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547569 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547706 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547842 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.547978 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548201 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548340 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548512 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548707 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548849 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.548995 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549142 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549279 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549426 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549569 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549713 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.549874 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.550057 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.550264 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.550795 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.550956 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551095 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551095 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551368 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551514 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551651 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551787 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.551924 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552073 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552212 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552349 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552485 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552633 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552769 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.552913 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553057 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553194 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553338 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553481 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553619 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.553793 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.554009 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.554152 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.554289 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.554435 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.554584 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.554730 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.554874 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.554874 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.555132 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.555269 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.555419 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556089 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:07:10.556239 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556377 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556515 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556515 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556800 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.556946 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557083 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557219 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557355 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557500 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557646 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557845 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.557989 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558137 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558283 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558513 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558668 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558806 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.558942 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559079 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559224 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559361 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559503 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559640 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559776 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.559931 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560082 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560235 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560373 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560520 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560657 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560792 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.560935 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561072 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561207 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561342 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561484 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561621 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561789 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.561934 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562069 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562206 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562361 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562506 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562652 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562798 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.562935 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563071 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563213 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563356 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563501 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563655 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563795 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.563932 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.564174 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.564334 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.564472 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.564609 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.564746 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.565136 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.565273 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.565417 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.565554 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.566283 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.566690 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.566918 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567068 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567227 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567367 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567503 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567639 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567639 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.567897 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568042 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568188 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568326 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568462 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568599 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568743 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.568890 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569040 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569177 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569314 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569452 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569596 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569734 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.569955 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570096 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570238 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570376 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570522 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570666 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570804 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.570950 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571093 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571231 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571445 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571585 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571723 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571859 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.571995 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572140 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572343 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572485 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572622 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572778 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.572917 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573065 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573204 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573340 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573476 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573619 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573774 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.573932 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574072 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574297 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574455 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574594 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574760 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.574969 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575114 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575257 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575396 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575532 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575677 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575814 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.575950 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576092 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576236 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576374 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576518 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576675 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576819 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.576956 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577092 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577235 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577384 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577529 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577673 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577852 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.577994 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578130 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578278 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578440 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578584 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578721 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.578856 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579000 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579137 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579272 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579407 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579544 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579679 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579823 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.579960 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580095 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580241 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580383 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580520 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580665 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580802 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.580938 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.581073 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.581245 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582035 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582136 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582209 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582473 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582553 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582780 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.582881 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583112 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583201 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583427 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583530 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583739 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.583855 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584045 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584143 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584355 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584453 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584667 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584765 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.584977 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585064 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585290 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585378 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585599 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585719 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.585937 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586039 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586253 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586340 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586570 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586668 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.586908 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587124 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587215 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587345 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587512 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587671 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.587825 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588026 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588123 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588347 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588447 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588649 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588745 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.588964 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589051 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589303 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589409 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589638 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589726 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.589975 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590063 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590299 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590400 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590609 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590695 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.590924 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591020 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591235 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591324 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591546 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591640 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591856 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.591951 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592165 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592253 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592483 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592570 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592796 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.592892 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593107 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593194 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593412 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593504 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593742 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.593858 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594059 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594154 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594377 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594458 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594678 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594772 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.594990 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595078 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595300 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595393 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595627 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595721 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.595939 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596039 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596247 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596347 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596550 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596650 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.596864 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597018 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597194 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597318 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597539 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597625 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597873 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.597965 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598193 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598279 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598519 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598608 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598833 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.598919 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599145 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599241 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599452 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599539 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599755 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.599842 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600060 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600146 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600365 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600454 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600669 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600755 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.600972 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601058 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601280 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601368 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601585 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601678 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.601918 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602018 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602231 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602316 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602541 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602629 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602841 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.602940 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603142 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603230 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603461 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603547 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603766 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.603863 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604068 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604155 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604368 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604455 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604672 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604769 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.604979 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605073 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605305 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605393 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605605 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605699 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.605936 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606024 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606255 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606343 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606551 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606647 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606862 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.606955 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607170 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607257 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607477 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607565 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607796 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.607883 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608108 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608194 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608414 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608502 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608727 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.608848 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609029 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609125 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609337 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609426 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609645 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609740 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.609988 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610090 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610292 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610379 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610599 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610685 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.610905 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611001 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611208 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611295 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611515 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611602 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611829 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.611928 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.612140 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.612400 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.612494 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.612781 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.612916 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613092 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613234 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613403 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613552 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613724 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.613880 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614199 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614316 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614528 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614651 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614853 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.614971 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615165 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615293 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615471 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615615 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615783 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.615936 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616088 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616269 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616390 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616598 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616697 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.616915 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617010 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617224 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617311 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617539 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617634 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617871 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.617974 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618180 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618275 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618481 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618580 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618790 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.618877 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619101 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619187 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619409 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619505 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619713 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.619800 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620019 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620104 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620320 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620407 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620641 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620729 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.620949 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621044 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621252 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621352 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621553 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621648 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621877 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.621969 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622185 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622271 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622512 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622612 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622825 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.622912 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623135 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623221 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623442 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623539 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623750 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.623838 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624056 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624141 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624380 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624475 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624682 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624778 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.624983 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625071 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625283 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625378 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625592 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625686 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.625921 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626011 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626222 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626311 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626530 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626618 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626843 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.626943 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627149 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627238 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627455 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627550 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627756 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.627930 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.628059 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.628656 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.628876 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629053 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629315 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629413 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629631 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629729 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.629961 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630050 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630263 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630365 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630569 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630657 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630874 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.630962 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631175 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631272 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631482 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631577 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631782 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.631870 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632094 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632182 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632395 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632483 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632694 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632781 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.632995 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633090 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633306 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633400 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633611 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633698 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.633935 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634026 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634246 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634332 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634554 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634654 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634853 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.634936 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635153 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635245 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635460 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635560 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635761 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.635850 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636063 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636152 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636367 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636463 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636680 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636766 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.636989 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637089 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637292 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637392 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637595 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637681 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.637920 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638011 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638265 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638365 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638514 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638611 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638820 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.638908 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639120 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639236 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639421 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639511 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639723 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.639819 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640025 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640114 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640328 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640423 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640637 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640735 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.640945 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641033 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641246 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641336 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641547 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641643 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641872 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.641963 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642185 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642273 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642507 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642604 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642821 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.642908 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.643133 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.643220 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.643444 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.643540 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.643792 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.644390 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.644657 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.644800 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.644971 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645118 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645336 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645423 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645649 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645735 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.645998 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646169 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646324 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646419 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646642 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646730 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.646946 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647041 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647251 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647338 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647558 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647645 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647876 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.647963 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648185 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648273 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648501 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648595 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648808 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.648896 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649117 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649212 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649423 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649516 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649732 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.649841 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650066 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650163 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650374 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650474 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650682 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650770 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.650988 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651076 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651298 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651393 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651608 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651696 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.651915 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652002 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652224 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652318 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652528 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652621 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652830 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.652919 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653138 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653305 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653447 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653535 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653749 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.653875 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654084 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654173 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654389 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654475 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654692 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654787 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.654998 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655088 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655301 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655388 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655610 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655697 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655908 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.655995 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656239 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656325 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656549 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656636 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656864 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.656952 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657172 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657271 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657484 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657583 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657809 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.657901 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658132 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658244 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658446 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658557 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658752 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.658849 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659156 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659252 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659490 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659591 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659801 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.659879 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660109 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660197 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660411 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660508 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660711 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.660800 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661019 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661137 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661340 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661452 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661643 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661804 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.661977 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662105 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662280 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662416 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662600 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662723 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.662904 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663037 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663223 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663367 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663636 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663724 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.663946 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664034 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664250 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664339 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664577 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664663 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664888 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.664984 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.665214 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.665301 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.665565 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.665652 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.665906 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666011 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666232 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666321 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666537 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666665 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666850 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.666981 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667158 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667295 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667485 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667624 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667805 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.667952 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668111 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668278 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668422 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668588 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668724 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.668908 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669045 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669220 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669366 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669548 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669678 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.669903 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670047 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670217 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670463 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670560 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670789 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.670878 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671098 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671186 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671417 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671511 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671742 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.671926 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672048 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672176 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672349 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672485 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672658 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672814 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.672962 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673128 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673264 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673452 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673584 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673809 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.673937 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674126 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674248 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674434 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674554 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674747 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.674861 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675102 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675220 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675410 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675489 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675793 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.675878 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676097 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676186 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676417 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676506 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676729 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.676830 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677049 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677138 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677370 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677466 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677675 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.677805 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678022 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678112 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678331 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678428 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678631 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678727 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.678932 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679028 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679234 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679335 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679575 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679664 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679877 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.679966 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680194 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680291 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680523 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680611 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680834 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.680956 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681143 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681233 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681449 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681543 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681809 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.681912 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682123 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682210 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682436 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682529 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682759 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.682852 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683061 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683150 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683362 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683450 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683668 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683765 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.683971 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684060 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684272 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684359 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684572 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684671 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684877 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.684972 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685177 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685265 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685479 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685576 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685798 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.685889 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686124 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686211 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686425 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686533 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686738 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.686822 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687041 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687128 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687345 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687440 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687646 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687733 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.687947 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688035 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688271 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688359 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688576 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688663 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.688902 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.689033 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.689213 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.689300 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.689516 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.689604 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.690102 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.690201 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.690411 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.690500 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.691385 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.691483 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.691718 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.691795 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692032 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692120 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692346 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692440 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692661 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692758 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.692974 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693063 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693287 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693376 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693599 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693792 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.693932 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694021 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694246 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694335 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694558 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694658 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694871 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.694967 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.695187 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.695388 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.695508 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.695714 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.695831 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696027 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696145 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696337 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696464 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696647 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696784 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.696959 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.697104 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.697270 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.697577 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.697666 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.697921 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698013 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698231 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698318 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698539 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698629 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698860 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.698947 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699177 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699274 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699496 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699584 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699813 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.699910 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700124 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700221 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700436 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700531 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700745 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.700832 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701055 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701152 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701382 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701472 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701714 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.701814 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702046 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702136 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702357 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702445 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702672 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702759 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.702983 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703079 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703292 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703390 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703601 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703689 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.703912 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704001 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704224 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704312 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704532 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704630 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704839 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.704929 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705152 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705246 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705464 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705560 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705814 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.705907 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.706121 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.706210 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.706988 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707075 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707322 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707427 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707622 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707712 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.707941 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708029 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708258 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708458 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708587 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708776 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.708929 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709112 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709255 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709442 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709574 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709778 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.709919 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.710111 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.710243 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.710431 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.710757 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.710858 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711063 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711152 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711368 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711456 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711677 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711775 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.711986 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712074 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712287 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712375 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712610 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712706 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.712922 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713010 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713227 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713314 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713545 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713635 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713876 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.713980 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.714190 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.714402 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.714500 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.714750 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.714840 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715065 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715152 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715391 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715491 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715716 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.715812 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716028 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716110 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716332 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716562 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716651 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.716915 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717010 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717236 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717332 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717560 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717673 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717894 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.717992 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718199 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718313 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718502 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718605 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718809 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.718906 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719117 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719217 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719420 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719508 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719729 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.719817 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720031 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720132 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720341 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720427 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720640 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720731 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.720941 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721042 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721242 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721330 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721549 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721636 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.721901 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722069 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722211 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722290 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722542 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722631 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722843 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.722933 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723152 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723239 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723452 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723541 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723761 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.723859 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724066 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724162 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724372 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724471 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724674 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724774 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.724981 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725068 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725279 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725375 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725593 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725680 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.725921 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726010 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726225 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726323 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726539 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726627 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726846 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.726940 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727158 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727257 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727469 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727561 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727780 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.727880 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728095 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728183 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728402 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728492 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728723 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.728938 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729036 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729312 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729408 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729633 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729722 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.729982 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730083 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730333 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730422 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730638 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730732 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.730943 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731176 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731266 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731554 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731643 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731865 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.731962 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732175 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732271 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732484 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732573 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732793 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.732891 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733102 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733190 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733410 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733498 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733720 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.733877 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734051 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734148 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734360 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734449 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734672 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734761 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.734987 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735078 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735303 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735398 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735615 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735703 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.735926 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736013 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736238 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736324 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736547 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736636 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736854 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.736942 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.737159 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.737254 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.737473 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.738173 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.738320 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.738510 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.738686 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.738836 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739070 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739158 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739380 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739469 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739764 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.739859 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740079 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740167 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740394 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740480 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740710 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.740809 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741019 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741107 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741342 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741436 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741651 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741746 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.741986 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742121 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742304 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742442 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742613 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742767 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.742939 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743094 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743273 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743410 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743600 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743745 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.743923 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744052 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744226 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744369 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744526 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744692 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.744833 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745013 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745137 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745346 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745465 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745688 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.745802 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746047 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746136 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746376 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746462 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746687 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746782 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.746997 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747093 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747307 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747396 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747621 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747708 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.747947 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748043 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748264 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748371 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748572 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748669 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.748899 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749019 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749207 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749309 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749512 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749608 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749842 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.749949 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750152 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750241 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750459 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750549 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750766 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.750856 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751088 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751176 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751410 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751499 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751713 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.751810 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752030 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752119 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752346 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752439 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752659 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752747 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.752971 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.753057 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.753921 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754178 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754271 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754548 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754638 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754864 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.754975 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755175 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755290 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755487 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755627 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755801 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.755955 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756115 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756284 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756441 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756609 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756767 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.756930 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757093 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757267 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757421 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757587 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757792 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.757934 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758104 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758255 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758451 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758561 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758775 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.758888 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759133 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759241 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759397 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759508 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759740 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759852 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.759977 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.766682 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.767353 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:07:10.767353 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 18:07:10.782912 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:10.787184 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_db.sqlalchemy.engines [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:10.850899 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.context [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c980a57-af87-4946-abcd-63304ecc43eb(cell1) {{(pid=102517) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 18:07:10.854404 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.context [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c980a57-af87-4946-abcd-63304ecc43eb(cell1) {{(pid=102518) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 18:07:10.855097 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_concurrency.lockutils [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:07:10.856662 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_concurrency.lockutils [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:07:10.857463 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_concurrency.lockutils [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:07:10.858589 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:07:10.859413 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_concurrency.lockutils [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:07:10.860175 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:07:10.860994 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:07:10.863659 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:07:10.871512 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:10.872309 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:10.875616 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_db.sqlalchemy.engines [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:10.880407 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_db.sqlalchemy.engines [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:11.131701 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:11.134509 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_db.sqlalchemy.engines [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:07:11.555512 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: WARNING keystonemiddleware.auth_token [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:07:11.562099 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: WARNING keystonemiddleware.auth_token [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:07:11.580023 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: WARNING keystonemiddleware.auth_token [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:07:11.586837 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: WARNING keystonemiddleware.auth_token [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:07:11.787149 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: WARNING keystonemiddleware.auth_token [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:07:11.792318 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: WARNING keystonemiddleware.auth_token [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:07:11.797672 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560ed0bd79c0 pid: 102517 (default app) Nov 24 18:07:11.799757 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:11.801533 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] 10.222.0.53 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002258 Nov 24 18:07:11.801964 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 1/1] 10.222.0.53 () {50 vars in 788 bytes} [Wed Nov 24 18:07:11 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:11.808613 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: WARNING keystonemiddleware.auth_token [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:07:11.813692 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: WARNING keystonemiddleware.auth_token [None req-9706cacb-6700-4aa8-a515-5d0e20176ebb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:07:11.820201 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560ed0bd79c0 pid: 102518 (default app) Nov 24 18:08:35.395794 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:35.396804 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 24 18:08:35.397216 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 2/2] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:35.938871 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-ebe0bd21-8f1f-4a3d-8216-d9f6dabe3c2e admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:35.968583 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-ebe0bd21-8f1f-4a3d-8216-d9f6dabe3c2e admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.563831 Nov 24 18:08:35.969118 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 1/3] 10.222.0.53 () {60 vars in 1291 bytes} [Wed Nov 24 18:08:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:38.279581 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:38.280565 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-4d5abbc8-e294-490d-ab6a-674078c7ea56 None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001378 Nov 24 18:08:38.280972 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 3/4] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:38.343578 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-c57f6312-1fa9-4f9f-851d-dc6039247e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "swap": 0, "ram": 256}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:38.362361 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:08:38.362361 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:08:38.440220 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-c57f6312-1fa9-4f9f-851d-dc6039247e89 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.152032 Nov 24 18:08:38.447769 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 2/5] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:38.810764 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-25160614-f7c6-48e9-b445-788ba32100dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:38.813637 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:08:38.813637 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: warnings.warn(msg) Nov 24 18:08:38.929863 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-25160614-f7c6-48e9-b445-788ba32100dc admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.480325 Nov 24 18:08:38.930621 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 4/6] 10.222.0.53 () {64 vars in 1335 bytes} [Wed Nov 24 18:08:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:41.257378 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-c57f6312-1fa9-4f9f-851d-dc6039247e89 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:41.258429 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-c57f6312-1fa9-4f9f-851d-dc6039247e89 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 24 18:08:41.258847 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 3/7] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:41.381233 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-835a082a-cf92-4128-b3ef-c763f5705516 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:41.400182 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:08:41.400182 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: warnings.warn(msg) Nov 24 18:08:41.471144 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-835a082a-cf92-4128-b3ef-c763f5705516 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.205746 Nov 24 18:08:41.471930 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 5/8] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:41.484530 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-64e4cb96-a596-44ca-9c41-c58d15b0aacd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:41.486876 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:08:41.486876 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:08:41.588549 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-64e4cb96-a596-44ca-9c41-c58d15b0aacd admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107728 Nov 24 18:08:41.597188 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 4/9] 10.222.0.53 () {64 vars in 1335 bytes} [Wed Nov 24 18:08:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:43.902249 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-835a082a-cf92-4128-b3ef-c763f5705516 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:43.903247 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-835a082a-cf92-4128-b3ef-c763f5705516 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Nov 24 18:08:43.903643 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 6/10] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:43.970767 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6fe21946-1f5a-4ca1-a532-fc033a84eefe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:44.094241 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-6fe21946-1f5a-4ca1-a532-fc033a84eefe admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.183549 Nov 24 18:08:44.099886 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 5/11] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:44.107686 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-ed7d9876-a2ed-4842-879e-7b79391d393c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:44.185139 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-ed7d9876-a2ed-4842-879e-7b79391d393c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081631 Nov 24 18:08:44.185909 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 7/12] 10.222.0.53 () {64 vars in 1335 bytes} [Wed Nov 24 18:08:44 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:46.535310 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6fe21946-1f5a-4ca1-a532-fc033a84eefe admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:46.536311 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-6fe21946-1f5a-4ca1-a532-fc033a84eefe admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 24 18:08:46.536709 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 6/13] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:46.596710 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-3a7d7dfe-701a-4bbb-976a-52b1f8197a74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:46.676344 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-3a7d7dfe-701a-4bbb-976a-52b1f8197a74 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133426 Nov 24 18:08:46.676987 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 8/14] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:08:46.689740 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6c66c712-70e2-47e0-ae18-955c504df42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:46.750008 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-6c66c712-70e2-47e0-ae18-955c504df42d admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063621 Nov 24 18:08:46.750142 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 7/15] 10.222.0.53 () {64 vars in 1335 bytes} [Wed Nov 24 18:08:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:08:49.080484 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-3a7d7dfe-701a-4bbb-976a-52b1f8197a74 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:49.082081 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-3a7d7dfe-701a-4bbb-976a-52b1f8197a74 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002507 Nov 24 18:08:49.082471 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 9/16] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:49.146433 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "rxtx_factor": 1.0}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:49.219060 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130412 Nov 24 18:08:49.219742 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 8/17] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:49.232480 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-fe342f82-1865-41d4-b569-dddc0330f2bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:49.364991 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-fe342f82-1865-41d4-b569-dddc0330f2bb admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136554 Nov 24 18:08:49.365567 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 10/18] 10.222.0.53 () {64 vars in 1335 bytes} [Wed Nov 24 18:08:49 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:08:51.686445 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:51.687471 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 24 18:08:51.688176 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 9/19] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:51.754252 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8847a1b0-17bf-41ef-8082-8136a4bac949 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:51.779732 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8847a1b0-17bf-41ef-8082-8136a4bac949 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084255 Nov 24 18:08:51.780272 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 11/20] 10.222.0.53 () {60 vars in 1291 bytes} [Wed Nov 24 18:08:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:08:54.311914 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:54.313190 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-7dab45fb-0914-44df-9f7c-604401a44d26 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 24 18:08:54.313660 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 10/21] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:54.375125 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8ed22a3f-235c-43b9-9796-d5817ea37a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:54.448881 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8ed22a3f-235c-43b9-9796-d5817ea37a6d admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128568 Nov 24 18:08:54.449590 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 12/22] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:54 2021] POST /compute/v2.1/flavors => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:54.464523 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-5e88fc8e-554b-4375-8b0c-454767bb9d56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:54.553100 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-5e88fc8e-554b-4375-8b0c-454767bb9d56 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092701 Nov 24 18:08:54.553711 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 11/23] 10.222.0.53 () {64 vars in 1332 bytes} [Wed Nov 24 18:08:54 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:56.978673 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8ed22a3f-235c-43b9-9796-d5817ea37a6d admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:56.979776 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8ed22a3f-235c-43b9-9796-d5817ea37a6d admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Nov 24 18:08:56.980236 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 13/24] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:57.039172 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-a17d8010-627a-4322-ad32-011299471787 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:57.107581 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-a17d8010-627a-4322-ad32-011299471787 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.120791 Nov 24 18:08:57.108349 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 12/25] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:08:57.121121 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-cb619f08-db32-40a6-b0e4-24f9c677646b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:57.226126 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-cb619f08-db32-40a6-b0e4-24f9c677646b admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108506 Nov 24 18:08:57.226738 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 14/26] 10.222.0.53 () {64 vars in 1332 bytes} [Wed Nov 24 18:08:57 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:08:59.548200 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-a17d8010-627a-4322-ad32-011299471787 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:08:59.549229 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-a17d8010-627a-4322-ad32-011299471787 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 24 18:08:59.549646 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 13/27] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:08:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:08:59.610572 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-33e07c03-e8d6-47b0-8cd8-ec0e9ce7c5c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:59.712013 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-33e07c03-e8d6-47b0-8cd8-ec0e9ce7c5c1 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.155099 Nov 24 18:08:59.712495 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 15/28] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:08:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:08:59.726373 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6a001615-0fc9-41e2-a79c-ea8c8ec1b314 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:08:59.816133 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-6a001615-0fc9-41e2-a79c-ea8c8ec1b314 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093843 Nov 24 18:08:59.816699 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 14/29] 10.222.0.53 () {64 vars in 1332 bytes} [Wed Nov 24 18:08:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:09:02.157304 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-33e07c03-e8d6-47b0-8cd8-ec0e9ce7c5c1 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:02.158883 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-33e07c03-e8d6-47b0-8cd8-ec0e9ce7c5c1 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Nov 24 18:09:02.159546 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 16/30] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:09:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:02.219482 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-25d5a0ed-3a1c-4b57-922b-6561fd9baf7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80, "swap": 0}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:02.281153 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-25d5a0ed-3a1c-4b57-922b-6561fd9baf7a admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.114957 Nov 24 18:09:02.281683 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 15/31] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:09:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:09:02.294657 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-7f515b01-b7c3-4f64-9fc6-c26a9ad21151 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:02.366014 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-7f515b01-b7c3-4f64-9fc6-c26a9ad21151 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074823 Nov 24 18:09:02.366604 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 17/32] 10.222.0.53 () {64 vars in 1332 bytes} [Wed Nov 24 18:09:02 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:09:04.695230 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-25d5a0ed-3a1c-4b57-922b-6561fd9baf7a admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:04.696254 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-25d5a0ed-3a1c-4b57-922b-6561fd9baf7a admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 24 18:09:04.697147 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 16/33] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:09:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:04.760607 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "swap": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:04.835967 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.132394 Nov 24 18:09:04.836639 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 18/34] 10.222.0.53 () {64 vars in 1282 bytes} [Wed Nov 24 18:09:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:09:04.849390 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-42ccb629-3fdf-4b0b-8cff-8d6ba772ee49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:04.936716 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-42ccb629-3fdf-4b0b-8cff-8d6ba772ee49 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091459 Nov 24 18:09:04.937410 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 17/35] 10.222.0.53 () {64 vars in 1332 bytes} [Wed Nov 24 18:09:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:09:26.885988 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:26.887865 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Nov 24 18:09:26.887865 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 19/36] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:09:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:26.947021 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-50992bd5-8b07-4d93-b9e3-8741743ff3f2 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:26.963816 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-50992bd5-8b07-4d93-b9e3-8741743ff3f2 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069532 Nov 24 18:09:26.964347 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 18/37] 10.222.0.53 () {60 vars in 1291 bytes} [Wed Nov 24 18:09:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:09:28.474634 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:28.475661 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-c9d75c00-629e-4452-9ac9-4161920f06f2 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 24 18:09:28.476067 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 20/38] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:28.666512 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-1ed376df-308f-41ae-a6fc-d2a086c1d616 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:28.671888 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.wsgi [None req-1ed376df-308f-41ae-a6fc-d2a086c1d616 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 18:09:28.672441 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-1ed376df-308f-41ae-a6fc-d2a086c1d616 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:28.673251 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-1ed376df-308f-41ae-a6fc-d2a086c1d616 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058684 Nov 24 18:09:28.674398 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 19/39] 10.222.0.53 () {60 vars in 1190 bytes} [Wed Nov 24 18:09:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 18:09:28.684032 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-a685caa4-0e20-4d29-ac8e-c5c1935cfc33 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:28.704310 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-a685caa4-0e20-4d29-ac8e-c5c1935cfc33 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023793 Nov 24 18:09:28.705715 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 21/40] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:09:28.715710 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-8927b021-fca9-4d86-bb15-e67287df891f admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:28.736972 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-8927b021-fca9-4d86-bb15-e67287df891f admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024650 Nov 24 18:09:28.737505 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 20/41] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:09:28.747258 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-b2fbea23-aebc-4bf5-ad52-07ecd4a74e58 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:28.752717 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.wsgi [None req-b2fbea23-aebc-4bf5-ad52-07ecd4a74e58 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 18:09:28.753274 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-b2fbea23-aebc-4bf5-ad52-07ecd4a74e58 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:28.754085 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-b2fbea23-aebc-4bf5-ad52-07ecd4a74e58 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010351 Nov 24 18:09:28.754572 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 22/42] 10.222.0.53 () {60 vars in 1190 bytes} [Wed Nov 24 18:09:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 24 18:09:30.142314 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-8927b021-fca9-4d86-bb15-e67287df891f admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:30.143327 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-8927b021-fca9-4d86-bb15-e67287df891f admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Nov 24 18:09:30.143717 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 21/43] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:30.338029 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-2c81df9b-dcb3-4282-a7b8-e2b657116b6f admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:30.343230 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.wsgi [None req-2c81df9b-dcb3-4282-a7b8-e2b657116b6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 18:09:30.343798 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-2c81df9b-dcb3-4282-a7b8-e2b657116b6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:30.344589 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-2c81df9b-dcb3-4282-a7b8-e2b657116b6f admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059006 Nov 24 18:09:30.345169 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 23/44] 10.222.0.53 () {60 vars in 1190 bytes} [Wed Nov 24 18:09:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 18:09:30.354960 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-545cb731-938b-4ae9-a6e9-fcf57c61229f admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:30.368797 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-545cb731-938b-4ae9-a6e9-fcf57c61229f admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017391 Nov 24 18:09:30.369344 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 22/45] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:09:30.379958 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8c83cc76-0db0-4705-8c2e-56aed9675fe2 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:30.393391 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8c83cc76-0db0-4705-8c2e-56aed9675fe2 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017526 Nov 24 18:09:30.394027 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 24/46] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:09:30.403777 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6a3db791-517b-46d3-b57b-695552aac7f0 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:30.409050 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.wsgi [None req-6a3db791-517b-46d3-b57b-695552aac7f0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 18:09:30.409617 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-6a3db791-517b-46d3-b57b-695552aac7f0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:30.410478 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-6a3db791-517b-46d3-b57b-695552aac7f0 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010134 Nov 24 18:09:30.410962 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 23/47] 10.222.0.53 () {60 vars in 1190 bytes} [Wed Nov 24 18:09:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 18:09:31.819863 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8c83cc76-0db0-4705-8c2e-56aed9675fe2 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:31.820856 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8c83cc76-0db0-4705-8c2e-56aed9675fe2 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 24 18:09:31.821253 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 25/48] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:32.014071 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-dd3807f4-8486-4bda-aa1a-ee46736aa3bc admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:32.019880 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.wsgi [None req-dd3807f4-8486-4bda-aa1a-ee46736aa3bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 18:09:32.020431 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-dd3807f4-8486-4bda-aa1a-ee46736aa3bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:32.021206 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-dd3807f4-8486-4bda-aa1a-ee46736aa3bc admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058389 Nov 24 18:09:32.021700 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 24/49] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:09:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 18:09:32.031569 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-48d52e66-5880-4c05-915a-8af269092c0f admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:32.045438 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-48d52e66-5880-4c05-915a-8af269092c0f admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017308 Nov 24 18:09:32.045998 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 26/50] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:09:32.056556 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:32.070313 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017652 Nov 24 18:09:32.070777 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 25/51] 10.222.0.53 () {60 vars in 1210 bytes} [Wed Nov 24 18:09:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:09:32.081574 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-1c254c10-1d0b-406a-9395-517e600b3ba1 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:32.086638 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.wsgi [None req-1c254c10-1d0b-406a-9395-517e600b3ba1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 18:09:32.087206 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-1c254c10-1d0b-406a-9395-517e600b3ba1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:09:32.087984 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-1c254c10-1d0b-406a-9395-517e600b3ba1 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011039 Nov 24 18:09:32.088470 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 27/52] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:09:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 18:09:33.472544 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:33.473541 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 24 18:09:33.473970 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 26/53] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:33.665389 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-1cf5764a-6a0a-4766-ba99-e03bc00d2b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:33.726497 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-1cf5764a-6a0a-4766-ba99-e03bc00d2b81 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.111412 Nov 24 18:09:33.727375 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 28/54] 10.222.0.53 () {64 vars in 1235 bytes} [Wed Nov 24 18:09:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:09:35.124131 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:35.125123 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Nov 24 18:09:35.125513 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 27/55] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:35.317601 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-a4407c73-60f6-4f0e-a4be-7b2909eefa92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:35.420819 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-a4407c73-60f6-4f0e-a4be-7b2909eefa92 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.154749 Nov 24 18:09:35.421377 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 29/56] 10.222.0.53 () {64 vars in 1235 bytes} [Wed Nov 24 18:09:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:09:36.817209 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:36.818235 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 24 18:09:36.821901 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 28/57] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:37.012953 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-6eb68d78-8940-4ff0-a825-952ffa9e7fce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:37.084345 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-6eb68d78-8940-4ff0-a825-952ffa9e7fce admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.123437 Nov 24 18:09:37.084791 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 30/58] 10.222.0.53 () {64 vars in 1235 bytes} [Wed Nov 24 18:09:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:09:38.505813 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:38.506804 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Nov 24 18:09:38.507630 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 29/59] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:38.702474 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-c4f51113-76ae-4ecd-8b06-f40b9bd967eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:09:38.780373 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-c4f51113-76ae-4ecd-8b06-f40b9bd967eb admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.131397 Nov 24 18:09:38.780820 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 31/60] 10.222.0.53 () {64 vars in 1235 bytes} [Wed Nov 24 18:09:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:09:40.172884 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:40.173961 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 24 18:09:40.174353 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 30/61] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:09:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:09:40.371870 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-26ad19fe-a24e-4c1b-ba8a-7db961556eb8 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:09:40.391540 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-26ad19fe-a24e-4c1b-ba8a-7db961556eb8 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074184 Nov 24 18:09:40.392553 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 32/62] 10.222.0.53 () {60 vars in 1202 bytes} [Wed Nov 24 18:09:40 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:10:27.162262 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.163253 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-548b953a-f744-4ca5-9b60-caa54029aef5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 24 18:10:27.163645 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 31/63] 10.222.0.53 () {54 vars in 930 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:10:27.221621 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-736bbccd-bc31-422d-a19c-9c24d86184ad admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.240359 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-736bbccd-bc31-422d-a19c-9c24d86184ad admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070488 Nov 24 18:10:27.240887 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 33/64] 10.222.0.53 () {60 vars in 1291 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:10:27.262818 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-f63bf93e-3f30-4153-a781-1bdbf30fa424 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.270926 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-f63bf93e-3f30-4153-a781-1bdbf30fa424 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011631 Nov 24 18:10:27.271445 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 32/65] 10.222.0.53 () {60 vars in 1282 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:10:27.283518 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-3b93a0f7-3cd7-49fe-b94e-8b415918c330 admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.291133 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-3b93a0f7-3cd7-49fe-b94e-8b415918c330 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011873 Nov 24 18:10:27.291645 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 34/66] 10.222.0.53 () {60 vars in 1285 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:10:27.303007 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-dec3c310-e52d-408a-ae7d-b3f740007fce admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.310541 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-dec3c310-e52d-408a-ae7d-b3f740007fce admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010892 Nov 24 18:10:27.311367 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 33/67] 10.222.0.53 () {60 vars in 1285 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:10:27.322743 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:10:27.330694 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011334 Nov 24 18:10:27.331203 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 35/68] 10.222.0.53 () {60 vars in 1282 bytes} [Wed Nov 24 18:10:27 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:12:05.364973 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-fd34c8ae-a035-4c1e-b4f7-5010e772d60b tempest-verify_tempest_config-745041162 tempest-verify_tempest_config-745041162-project] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:12:05.366931 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-fd34c8ae-a035-4c1e-b4f7-5010e772d60b tempest-verify_tempest_config-745041162 tempest-verify_tempest_config-745041162-project] 10.222.0.53 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108521 Nov 24 18:12:05.367458 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 34/69] 10.222.0.53 () {58 vars in 1133 bytes} [Wed Nov 24 18:12:05 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:13:33.166101 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:33.167118 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 24 18:13:33.167701 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 36/70] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:13:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:13:33.428179 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:33.429441 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:13:33.429441 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:13:33.431100 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:33.431806 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:33.432627 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:33.433046 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:33.468054 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-35f8ffa5-d32a-4347-a15a-7f62e192df59 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154741 Nov 24 18:13:33.468620 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 35/71] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:13:33 2021] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:13:34.898828 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:34.899821 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Nov 24 18:13:34.900215 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 37/72] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:13:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:13:35.099800 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:35.101032 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:13:35.101032 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:13:35.102572 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:35.103016 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:35.103835 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:35.104275 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:35.129865 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-08d99bb4-97b2-415a-b72f-e14df466140d admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089491 Nov 24 18:13:35.130345 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 36/73] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:13:35 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:13:46.964316 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:46.965318 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 24 18:13:46.965720 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 38/74] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:13:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:13:47.159800 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:47.160950 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:13:47.160950 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:13:47.162490 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:47.162932 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:47.163729 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:47.164158 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:47.187242 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-3047528d-3ac2-4544-82b9-0bd98db9f198 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078826 Nov 24 18:13:47.187713 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 37/75] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:13:47 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:13:48.611879 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: DEBUG nova.api.openstack.wsgi [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] Calling method '>' {{(pid=102517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:48.612879 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: INFO nova.api.openstack.requestlog [None req-8d86169a-0430-4cbd-ab29-475c06ada95c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 24 18:13:48.613281 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: [pid: 102517|app: 0|req: 39/76] 10.222.0.53 () {56 vars in 1074 bytes} [Wed Nov 24 18:13:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:13:48.809299 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG nova.api.openstack.wsgi [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] Calling method '>' {{(pid=102518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:48.810417 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:13:48.810417 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: warnings.warn(msg) Nov 24 18:13:48.811941 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:48.812370 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:48.813145 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:13:48.813560 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: DEBUG oslo_concurrency.lockutils [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:13:48.835040 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: INFO nova.api.openstack.requestlog [None req-c095bf7d-1324-481f-ad3a-18c45bbed217 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076156 Nov 24 18:13:48.835585 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: [pid: 102518|app: 0|req: 38/77] 10.222.0.53 () {60 vars in 1193 bytes} [Wed Nov 24 18:13:48 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:14:44.345062 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: Wed Nov 24 18:14:44 2021 - graceful shutdown triggered... Nov 24 18:14:44.345707 dv-cinder-804035-22-iscsi devstack@n-api.service[102517]: Gracefully killing worker 1 (pid: 102517)... Nov 24 18:14:44.346450 dv-cinder-804035-22-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 24 18:14:44.347394 dv-cinder-804035-22-iscsi devstack@n-api.service[102518]: Gracefully killing worker 2 (pid: 102518)... Nov 24 18:14:45.346213 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: worker 1 buried after 1 seconds Nov 24 18:14:45.346778 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: worker 2 buried after 1 seconds Nov 24 18:14:45.346778 dv-cinder-804035-22-iscsi devstack@n-api.service[102516]: goodbye to uWSGI. Nov 24 18:14:45.347736 dv-cinder-804035-22-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 24 18:14:45.348288 dv-cinder-804035-22-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 24 18:14:45.351164 dv-cinder-804035-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 18:14:45.360470 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 18:14:45 2021] *** Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: nodename: dv-cinder-804035-22-iscsi Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: machine: x86_64 Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: clock source: unix Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: pcre jit disabled Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: detected number of CPU cores: 4 Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: current working directory: / Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: detected binary path: /usr/bin/uwsgi-core Nov 24 18:14:45.363208 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: your processes number limit is 47680 Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: your memory page size is 4096 bytes Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: detected max file descriptor number: 2048 Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: lock engine: pthread robust mutexes Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: thunder lock: enabled Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 18:14:45.363970 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 18:14:45.409699 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: Python main interpreter initialized at 0x55985b6969c0 Nov 24 18:14:45.409699 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: python threads support enabled Nov 24 18:14:45.409699 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: your server socket listen backlog is limited to 100 connections Nov 24 18:14:45.409699 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: your mercy for graceful operations on workers is 90 seconds Nov 24 18:14:45.410159 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 18:14:45.410159 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: *** Operational MODE: preforking *** Nov 24 18:14:45.410477 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: *** uWSGI is running in multiple interpreter mode *** Nov 24 18:14:45.410477 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: spawned uWSGI master process (pid: 116713) Nov 24 18:14:45.410694 dv-cinder-804035-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 18:14:45.413822 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: spawned uWSGI worker 1 (pid: 116730, cores: 1) Nov 24 18:14:45.413822 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: spawned uWSGI worker 2 (pid: 116731, cores: 1) Nov 24 18:14:45.413822 dv-cinder-804035-22-iscsi devstack@n-api.service[116713]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 18:14:47.178128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:14:47.178128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: from cryptography.utils import int_from_bytes Nov 24 18:14:47.178823 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:14:47.178823 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: from cryptography.utils import int_from_bytes Nov 24 18:14:47.199638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:14:47.199638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: from cryptography.utils import int_from_bytes Nov 24 18:14:47.200273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 18:14:47.200273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: from cryptography.utils import int_from_bytes Nov 24 18:14:49.502801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 18:14:49.503389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 18:14:49.503568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 18:14:49.503913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 18:14:49.504164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 18:14:49.504551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.504882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.505200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.505518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.505871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.506184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.506501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.506822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.507151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.507410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.507729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.508052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-22-iscsi {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.508372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.508682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.508991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.509308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.509611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.509957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.510262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.510762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.512182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.512182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.512182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.512450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.512733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.513044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.513363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.513677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.514029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.514345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.514759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-22-iscsi {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.515079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.515381 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.515692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.516097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.516411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.516718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.517039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.517921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.518242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.518574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.518889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.519207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.519528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.519826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.520135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.520444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.520762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.521067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.521371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.521619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.521950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.522276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.522595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.522914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.523165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.523414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.523730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.524047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.524365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.524671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.524967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.525275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.525583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.525917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.526228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.526539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.526855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.527170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.527492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.527799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.528121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.528519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.528771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.529075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.529412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.529728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.530055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.530370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.530688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.530993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.531294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.531597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.531916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.532250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.532551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.532800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.533669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.533997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.534334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.534619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.534925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.535237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.535539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.535844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.536147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.536454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.536763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.537070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.537372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.537678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.538008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.538318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.538636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.538956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.539264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.539567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.539874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.540184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.540503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.540809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.541118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.541435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.541740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.542067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.542520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.542691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.542984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.543303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.543605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.543912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.544228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.544535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.544841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.545143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.545450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.545747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.546101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.546365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.546671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.546969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.547284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.547605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.547910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.548222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.548527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.548975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.549214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.549517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.549926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.550191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.550525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.552859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.553135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.553285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.553602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.553947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.554543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.554864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.555182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.555591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.555856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.556123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.556451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.556775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.557086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.557924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.557924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.558319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.558647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.558959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.559283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.559664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.559907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.560222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.560554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.560868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.561182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.561520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.564983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.566577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.568466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.569272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.569272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.569272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.569692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.569978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.570150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.570513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.570791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.571055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.571387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.571716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.572021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.572347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.572672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.572987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.573220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 18:14:49.573681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.573891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 18:14:49.574050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.574050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.574350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 18:14:49.574501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.574655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 18:14:49.574901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.575113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 18:14:49.575263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.575405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.575549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.575707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.575860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.576223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.576383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.576569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.576786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.576965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.577182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.577360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.577578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.577736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.577958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.577958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.578262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.578407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.578558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.578558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.578862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.579010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.579161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.579306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-22-iscsi {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.579457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.579611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.579769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.580758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.580942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.581102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.581248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.581399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.581576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.581729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.581909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.582055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.582212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.582365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.582518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.582670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.582842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.582995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.583147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.583317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.583471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.583622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.583773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.583923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.584074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.584232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.584378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.584521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.584671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.584823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.584967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.585121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.585276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.585426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.585571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.585721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.585912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.585912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.586444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-22-iscsi {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.586444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.586730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.586970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.587130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.587371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.587521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.587521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.587906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.588063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.588208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.588360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.588505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.588656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.588910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.589076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.589229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.589382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.589528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.589678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.589916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.590066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.590209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.590209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.590492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.591064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.591228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.591382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.591670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.591824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.591977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.592129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.592291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.592450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.592604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.592755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.592907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.593052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.593394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.593557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.593713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.593894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.594041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.594185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.594338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.594508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.594654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.594805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.595000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.595153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.595153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.595462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.596567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.596733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.596889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.597122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.597296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.597526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.597685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.597944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.598116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.598278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.598431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.598577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.598721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.598872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.599020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.599174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.599326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.599492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.599645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.599797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.599944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.600098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.600242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.600386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.600540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.600713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.600940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.601210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.601371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.601524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.601682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.601871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.602022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.602176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.602322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.602322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.602606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.602757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.602916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.603069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.603222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.603368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.603512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.603667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.603826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.604043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.604215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.604215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.604215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.605227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.605393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.605541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.605694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.605867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.606023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.606177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.606344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.606720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.606881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.607034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.607264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.607426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.607656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.607816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.608055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.608216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.608363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.608521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.608824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.609004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.609153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.609305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.609458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.609618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.609784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.610621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.610791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.610981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.611479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.611645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.611811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.611973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.612180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.612338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.612490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.612651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.612811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.612970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.613133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.613294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.613445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.613597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.613822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.614008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.614172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.614324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.614474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.614474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.614763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.614915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.615074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.615313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.615476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.615629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.615788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.615956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.616121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.616121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.616425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.616835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.617009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.617169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.617423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.617583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.617832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.617992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.618252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.618417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.618582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.618745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.618908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.619062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.619222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.619388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.619549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.619710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.619864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.620015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.620175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.620334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.620486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.620732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.620886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.621039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.621263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.621699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.622172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.622335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.622488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.622639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.622803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.622964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.623102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.623389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.623528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.623642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.624319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.624417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.624512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.624645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.624747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.624834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.624930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.625110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.625277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.625462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 18:14:49.625631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.625994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.626641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.627997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.628988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.629979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.630961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.631948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.632950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.633926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.634960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.635916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.636936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.637917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.638845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.639793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.640946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.641895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.642002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.642204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.642850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.643968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.644991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.645971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.646839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.647988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.648952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.649186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.653942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.654980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.655981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.656974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.657888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.658624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.658624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.658924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.659921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.660927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.661095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.661259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.661664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.661860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.661997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.662966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.663913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.664853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.665861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.666845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.667978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.668994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.669947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.670894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.671994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.672935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.673902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.674906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.675844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.676784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.677961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.678979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.679189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.679690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.679794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.679889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.680949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.681896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.682924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.683824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.684772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.685013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.685124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.685336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.685420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.685743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.686148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.686466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.686548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.686773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.686858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.687099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.687189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.687884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.687996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.687996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.688993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.689093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.689325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.689743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.690223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.690429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.690516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.690762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.690857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.691871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.692929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.693900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.694983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.695941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.696892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.697871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.698797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.699924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.700879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.701867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.702977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.703914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.704012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.704238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.704483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.704629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.704728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.705335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.705620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.705745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.706980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.707910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.708006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.708219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.708312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.709889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.710813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.711992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.712941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.713925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.714848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.715953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.716974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.717172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.717265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.717480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.717574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.717801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.726631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.726744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.726824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.726914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.726991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.727942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.728938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.729958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.730922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.731886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.732953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.733920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.734939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.735972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.736570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.736749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.737958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.738848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.739811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.740842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.741750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.742987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.743969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.744253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.744445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.744613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.744758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.745998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746776 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.746930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.747888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.748863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.749869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.750878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.751094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.751246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.751380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.751512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.751774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.752495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.752646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.752910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.753909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.754960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.755906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.756098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.756222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.756402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.756530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.756653 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 18:14:49.756767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.757028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.757336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.757675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.758005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.758342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.758663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.758986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.759312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.759624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.759948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.760263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.760579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.760897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.761213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.761529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.761867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.762186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.762500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.762816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.763133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.763449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.764007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.764335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.764649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.764963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.765343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.765588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.765929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.766246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.766679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.767065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.767383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.767717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.768097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.768429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.768768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.769088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.769403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.769720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.770059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.770420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.770745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.771041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.771348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.771664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.771980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.772292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.772604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.772919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.773232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.773543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.774000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.775012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.775012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.775232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.775953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.776201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.777798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.777798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.777798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.777798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.778150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.778504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.778841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.779175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.779579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.779966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.780335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.780453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:49.780652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.780964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.781285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.781602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.782097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.782341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.782657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.783026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.783430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.783755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.784310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.784665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.784987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.785318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.785655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.786000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.786313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.786689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.786985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.787297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.787619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.787948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.788248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.788557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.788874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.789187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.789496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.789827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.790139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.790468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.790777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.791086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.791396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.791708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.792020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.792324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.792639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.792936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.793247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.793551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.793884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.794191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.794504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.794811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.795123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.795427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.795758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.796063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.796369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.796692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.797006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.797331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.797647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.798009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.798364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.799337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.800072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.800468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.800799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.801295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.801641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.802028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.802350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.802655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.802989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.803474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.804008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.804764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.805091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.805415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.805737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.806087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.806407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.806728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.807050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.807410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.807739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.808065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.808386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.808727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.809025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.809339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.809653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.809990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.810311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.810646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.810964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.811465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.811713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.812031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.812378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.812680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.812996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.813323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.813650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.814018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.815042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.815499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.815843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.816194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.816530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.816859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.817170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.817573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.817917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.818130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.818521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.818798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.819120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.819448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.819769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.820096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.820411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.820737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.821064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.821803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.821803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.822137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.822361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.822677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.822994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.823310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.823626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.824031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.824274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.824606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.824912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.825241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.825561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.825912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.826233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.826546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.826881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.827194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.827515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.827856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.828160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.828444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.828767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.829097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.829425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.829753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.830134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.830493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.830865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.831178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.831509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.832015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.832184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.832422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 18:14:49.832671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 18:14:49.856875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_db.sqlalchemy.engines [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:49.949123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.context [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c980a57-af87-4946-abcd-63304ecc43eb(cell1) {{(pid=116731) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 18:14:49.951798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:14:49.953443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:14:49.954351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:14:49.956528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:14:49.967496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:49.968832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:50.014676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.context [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c980a57-af87-4946-abcd-63304ecc43eb(cell1) {{(pid=116730) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 18:14:50.019446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:14:50.021173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:14:50.022148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:14:50.024204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:14:50.036208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_db.sqlalchemy.engines [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:50.037088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_db.sqlalchemy.engines [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:50.134551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:50.198895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_db.sqlalchemy.engines [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 18:14:50.471057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: WARNING keystonemiddleware.auth_token [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:14:50.477958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: WARNING keystonemiddleware.auth_token [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:14:50.521458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: WARNING keystonemiddleware.auth_token [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:14:50.527961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: WARNING keystonemiddleware.auth_token [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:14:50.823531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: WARNING keystonemiddleware.auth_token [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:14:50.829168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: WARNING keystonemiddleware.auth_token [None req-a3d8fe24-2152-47c9-8aa0-2a5a9559c051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:14:50.835446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55985b6969c0 pid: 116731 (default app) Nov 24 18:14:50.872888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: WARNING keystonemiddleware.auth_token [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 18:14:50.878150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: WARNING keystonemiddleware.auth_token [None req-cdeb1fbf-acb3-4a7a-8fd4-fc9a863af577 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 18:14:50.883469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55985b6969c0 pid: 116730 (default app) Nov 24 18:15:24.942096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-168db0cf-c207-4fc3-a41a-d764f2216c50 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Action: 'create', calling method: .version_select at 0x7f8ba9be2550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1548859013", "metadata": {"Type": "work"}}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:24.943694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-168db0cf-c207-4fc3-a41a-d764f2216c50 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:24.944620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-168db0cf-c207-4fc3-a41a-d764f2216c50 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.025683 Nov 24 18:15:24.945188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1/1] 10.222.0.53 () {60 vars in 1155 bytes} [Wed Nov 24 18:15:23 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1028 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 18:15:25.164093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a8b6da1-128f-4d56-9dc4-78a1c97ef42d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Action: 'create', calling method: .version_select at 0x7f8ba9c2b160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1295201243", "metadata": {"Type": "work"}}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:25.165839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a8b6da1-128f-4d56-9dc4-78a1c97ef42d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:25.166766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a8b6da1-128f-4d56-9dc4-78a1c97ef42d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.215265 Nov 24 18:15:25.167340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1/2] 10.222.0.53 () {60 vars in 1155 bytes} [Wed Nov 24 18:15:24 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 18:15:25.177135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdfeaab7-ae5a-45cf-8270-a213ebda1d2d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Action: 'create', calling method: .version_select at 0x7f8ba9ab5160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-451733964", "metadata": {"Type": "work"}}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:25.178320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdfeaab7-ae5a-45cf-8270-a213ebda1d2d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:25.186741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cdfeaab7-ae5a-45cf-8270-a213ebda1d2d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006949 Nov 24 18:15:25.186741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 2/3] 10.222.0.53 () {60 vars in 1155 bytes} [Wed Nov 24 18:15:25 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 18:15:25.192186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e69b2bab-ea1c-4192-a3a2-a596622e4f8d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Calling method '.version_select at 0x7f8ba9c2bdc0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:26.306405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-e69b2bab-ea1c-4192-a3a2-a596622e4f8d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] HTTP exception thrown: Volume tempest-invalid-1720640396 could not be found. Nov 24 18:15:26.309477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e69b2bab-ea1c-4192-a3a2-a596622e4f8d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 404 to user: Volume tempest-invalid-1720640396 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:26.311661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e69b2bab-ea1c-4192-a3a2-a596622e4f8d tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1720640396" status: 404 len: 99 microversion: 2.1 time: 1.122932 Nov 24 18:15:26.313233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 2/4] 10.222.0.53 () {58 vars in 1217 bytes} [Wed Nov 24 18:15:25 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1720640396 => generated 99 bytes in 1126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 24 18:15:26.326855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b4f5625f-5160-4b62-9da4-bd144ac617cb tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007208 Nov 24 18:15:26.328809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 3/5] 10.222.0.53 () {58 vars in 1139 bytes} [Wed Nov 24 18:15:26 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 24 18:15:26.343177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7f5ac9c-6782-4aa5-943b-eb156a497908 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004334 Nov 24 18:15:26.344175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 3/6] 10.222.0.53 () {58 vars in 1136 bytes} [Wed Nov 24 18:15:26 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 18:15:26.361220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-db7fbd22-8240-409f-b051-34504d24b81b tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Calling method '.version_select at 0x7f8ba9be2c10>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:27.014007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.wsgi [None req-db7fbd22-8240-409f-b051-34504d24b81b tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] HTTP exception thrown: Volume 07624fcd-eb79-479e-ad60-7a582293a779 could not be found. Nov 24 18:15:27.014007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-db7fbd22-8240-409f-b051-34504d24b81b tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 404 to user: Volume 07624fcd-eb79-479e-ad60-7a582293a779 could not be found. {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:27.015327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-db7fbd22-8240-409f-b051-34504d24b81b tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/07624fcd-eb79-479e-ad60-7a582293a779" status: 404 len: 109 microversion: 2.1 time: 0.666017 Nov 24 18:15:27.020310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 4/7] 10.222.0.53 () {58 vars in 1247 bytes} [Wed Nov 24 18:15:26 2021] DELETE /compute/v2.1/os-volumes/07624fcd-eb79-479e-ad60-7a582293a779 => generated 109 bytes in 667 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:15:27.026533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42927701-1bca-4b53-8a03-af6ed64c62e6 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Calling method '.version_select at 0x7f8ba9a80670>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:27.076245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-42927701-1bca-4b53-8a03-af6ed64c62e6 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] HTTP exception thrown: Volume 5334525e-b923-491e-a2c6-a5abd748c74d could not be found. Nov 24 18:15:27.076838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42927701-1bca-4b53-8a03-af6ed64c62e6 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] Returning 404 to user: Volume 5334525e-b923-491e-a2c6-a5abd748c74d could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:15:27.077848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42927701-1bca-4b53-8a03-af6ed64c62e6 tempest-VolumesNegativeTest-1664046112 tempest-VolumesNegativeTest-1664046112-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/5334525e-b923-491e-a2c6-a5abd748c74d" status: 404 len: 109 microversion: 2.1 time: 0.055626 Nov 24 18:15:27.078544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 4/8] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:15:27 2021] GET /compute/v2.1/os-volumes/5334525e-b923-491e-a2c6-a5abd748c74d => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:15:27.566250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1830547631", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "d880d6ba-107a-4ad6-b8bf-f00c7b39332c"}]}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:27.718641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.network.neutron [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] validate_networks() for [('d880d6ba-107a-4ad6-b8bf-f00c7b39332c', None, None, None, None, None)] {{(pid=116731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:28.371483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-259141453", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "fe66d9b3-7253-489d-a459-93918bf1a999"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:28.538192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] validate_networks() for [('fe66d9b3-7253-489d-a459-93918bf1a999', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:29.223532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:29.224052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:29.224536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:29.224945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:29.225354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:29.243331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:29.243774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:29.244588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:29.245018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:29.286860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:29.306589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for user 5bf4f94ef33c406f86a393463f4f20c2 and project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:29.319752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Going to run 1 instances... {{(pid=116731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:29.323163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:29.504659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-40c2b06c-bec9-4c3b-ab46-d1890a74c11d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.401022 Nov 24 18:15:29.504659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 5/9] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:15:29.520133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5de06098-aafc-4878-90b9-36266c5e9288 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:29.520991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5de06098-aafc-4878-90b9-36266c5e9288 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:29.941712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5de06098-aafc-4878-90b9-36266c5e9288 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:29.959846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5de06098-aafc-4878-90b9-36266c5e9288 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1218 microversion: 2.1 time: 0.449615 Nov 24 18:15:29.961104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 6/10] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:29 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1218 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:30.034500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:30.035284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:30.037408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:30.038030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:30.038503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:30.073615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:30.077683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:30.079192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:30.080005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:30.128084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Getting quotas for project 8008d8625c3949a98af18c6a8eb18a03. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:30.135500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Getting quotas for user 91a76b4ab7cb44e3ae2422d4d9056864 and project 8008d8625c3949a98af18c6a8eb18a03. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:30.151002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:30.156208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:30.347126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-043e40b9-fed7-4434-aca5-f7ea70ec6611 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141422 Nov 24 18:15:30.357861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 5/11] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:15:30.363600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a5ba0b82-997f-4610-990f-e317c84fa46e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:30.364625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a5ba0b82-997f-4610-990f-e317c84fa46e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:30.655715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a5ba0b82-997f-4610-990f-e317c84fa46e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:30.667547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a5ba0b82-997f-4610-990f-e317c84fa46e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1214 microversion: 2.1 time: 0.307986 Nov 24 18:15:30.674142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 7/12] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:30 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:30.980415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-480134c0-dfdb-43c3-b6d8-46c46963b111 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:30.981114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-480134c0-dfdb-43c3-b6d8-46c46963b111 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:31.117843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-480134c0-dfdb-43c3-b6d8-46c46963b111 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:31.149688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-480134c0-dfdb-43c3-b6d8-46c46963b111 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1218 microversion: 2.1 time: 0.168260 Nov 24 18:15:31.151078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 6/13] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:30 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:31.692617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-be623541-ee22-46c3-9dd0-caee1afbaea6 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:31.692617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-be623541-ee22-46c3-9dd0-caee1afbaea6 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:31.887923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-be623541-ee22-46c3-9dd0-caee1afbaea6 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:31.895755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-be623541-ee22-46c3-9dd0-caee1afbaea6 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1214 microversion: 2.1 time: 0.214551 Nov 24 18:15:31.898665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 8/14] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:31 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:32.166556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-65765d4c-0c35-4403-ac8d-62a9e714a7f1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:32.167168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-65765d4c-0c35-4403-ac8d-62a9e714a7f1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:32.444917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-65765d4c-0c35-4403-ac8d-62a9e714a7f1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:32.453553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-65765d4c-0c35-4403-ac8d-62a9e714a7f1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1218 microversion: 2.1 time: 0.290745 Nov 24 18:15:32.455995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 7/15] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:32 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:32.915205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-563eaa9b-34eb-49e2-9bae-9cc38e64aafb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:32.915725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-563eaa9b-34eb-49e2-9bae-9cc38e64aafb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:33.109396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-563eaa9b-34eb-49e2-9bae-9cc38e64aafb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:33.144835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-563eaa9b-34eb-49e2-9bae-9cc38e64aafb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1214 microversion: 2.1 time: 0.227862 Nov 24 18:15:33.159405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 9/16] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:32 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:33.473800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:33.474672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:33.494818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:33.495735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:33.498394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:33.499932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:33.723272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:33.737109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-29b98c2b-945d-400b-9d33-6355a0fa4a1f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1214 microversion: 2.1 time: 0.267706 Nov 24 18:15:33.738552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 8/17] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:33 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:34.167462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:34.168759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:34.180684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:34.201151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:34.203556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:34.204002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:34.755375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:34.756942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:34.771609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:34.773805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:34.783535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:34.784877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:34.871108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:34.898575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4ec18372-dfbe-4ccd-a51a-39fc8284414c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1218 microversion: 2.1 time: 0.732598 Nov 24 18:15:34.912090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 10/18] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:34 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1218 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:34.960969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:34.965403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b3bd8195-2df5-424d-88e5-92ef2449040e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1270 microversion: 2.1 time: 0.214022 Nov 24 18:15:34.966019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 9/19] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:34 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:35.926147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:35.927476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:35.941640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:35.943420 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:35.945722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:35.946190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:35.982674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:35.983289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:35.997784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:35.998483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:35.999498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:36.001052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:36.223420 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:36.231478 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-72b51afa-8f52-4f2a-a945-03fd10bb9f0a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1274 microversion: 2.1 time: 0.318830 Nov 24 18:15:36.247406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 11/20] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:35 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:36.309391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:36.320287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4f1f7571-27f4-4b6b-a087-e8410fb2fcb1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1276 microversion: 2.1 time: 0.338202 Nov 24 18:15:36.322731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 10/21] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:35 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:37.255362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:37.256024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:37.267741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:37.270460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:37.271645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:37.274405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:37.339320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:37.339993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:37.358548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:37.358548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:37.358548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:37.358548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:37.581895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:37.592123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1cab3a96-ce98-47ab-93fd-6636f05e3e3b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1276 microversion: 2.1 time: 0.257403 Nov 24 18:15:37.603762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 11/22] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:37 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:37.804759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:37.819108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d6669f27-bacd-4549-86c0-6c2b16c16141 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1272 microversion: 2.1 time: 0.567301 Nov 24 18:15:37.821832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 12/23] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:37 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1272 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:38.616176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:38.616176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:38.631747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:38.635669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:38.642647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:38.644314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:39.137183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:39.145637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2fb45685-e0f3-4f5d-9a05-589b0ea24cbd tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1276 microversion: 2.1 time: 0.539110 Nov 24 18:15:39.162939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 13/24] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:38 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1276 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:39.186561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:39.188221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:39.208240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:39.212930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:39.214097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:39.217615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:39.383342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1244844404", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b5e41ba-90ac-4f1e-b364-aff518b9c61c"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:39.550610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] validate_networks() for [('7b5e41ba-90ac-4f1e-b364-aff518b9c61c', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:39.862865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:39.876098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-709d65a1-d51b-47e1-a823-1391c3a8570d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1272 microversion: 2.1 time: 0.709023 Nov 24 18:15:39.878561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 14/25] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:39 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1272 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:40.164020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:40.164638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:40.184914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.189703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.190564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.191154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.378519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:40.410777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e33b8cb5-3f46-403e-a0d1-e694606b8b6c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1276 microversion: 2.1 time: 0.243396 Nov 24 18:15:40.414730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 15/26] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:40 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:40.433903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:40.434879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:40.435607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:40.436429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:40.437062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:40.448853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.455190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.455190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.455190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.474735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Getting quotas for project fe321c3b30984971a98e41f672e2c582. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:40.479549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Getting quotas for user 2b3c2e8e2bca4a38a473ab0e3641354d and project fe321c3b30984971a98e41f672e2c582. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:40.493512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:40.496979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:40.899084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:40.899690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:40.903985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9ca0a8a6-0adb-4f09-a4bb-206c76692f04 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.344080 Nov 24 18:15:40.907529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 12/27] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:15:40.909650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.910265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.911185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:40.911745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:40.919207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ede3c30-72b4-4cd9-bab7-5105ad655d6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:40.920504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ede3c30-72b4-4cd9-bab7-5105ad655d6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:41.119578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ede3c30-72b4-4cd9-bab7-5105ad655d6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:41.135279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ede3c30-72b4-4cd9-bab7-5105ad655d6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1222 microversion: 2.1 time: 0.221237 Nov 24 18:15:41.150622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 13/28] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:41.434578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:41.441631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:41.454636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:41.455101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:41.461118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:41.462531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:41.909680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:41.919989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-973e1dc4-64b0-406c-9a16-5cbe0fecc247 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.492524 Nov 24 18:15:41.920621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 14/29] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:41 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:41.941570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1665805877", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b5e41ba-90ac-4f1e-b364-aff518b9c61c"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:42.065974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] validate_networks() for [('7b5e41ba-90ac-4f1e-b364-aff518b9c61c', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:43.263915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:43.273436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7726a1f6-4823-490e-9068-4ac2027feef2 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 2.380518 Nov 24 18:15:43.278004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:43.278479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 16/30] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:40 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:43.279760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:43.280461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:43.282907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:43.287446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:43.298063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:43.298063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:43.309749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:43.310198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:43.313441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:43.315972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:43.325850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:43.326309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:43.327116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:43.327555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:43.386498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Getting quotas for project fe321c3b30984971a98e41f672e2c582. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:43.402808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Getting quotas for user 2b3c2e8e2bca4a38a473ab0e3641354d and project fe321c3b30984971a98e41f672e2c582. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:43.438537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:43.441939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:43.709399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6aa41412-f09f-4b08-9195-0595eabf89b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.778197 Nov 24 18:15:43.712311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 15/31] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:15:43.725595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e09f4213-36bd-4dc0-a256-46e23e8df0aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:43.729512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e09f4213-36bd-4dc0-a256-46e23e8df0aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:43.803610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e09f4213-36bd-4dc0-a256-46e23e8df0aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:43.832498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e09f4213-36bd-4dc0-a256-46e23e8df0aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1222 microversion: 2.1 time: 0.095202 Nov 24 18:15:43.832498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 16/32] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:43 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:44.252992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:44.261304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a78438c7-cfc6-4b89-a888-5cd96e58bf30 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.981695 Nov 24 18:15:44.277810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 17/33] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:43 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:44.290904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:44.292131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:44.301349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:44.301941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:44.302626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:44.303326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:44.598860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:44.606624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ffd6769-7729-4cd9-9895-9900ad136521 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.319354 Nov 24 18:15:44.608354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 17/34] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:44 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:44.838159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-12e47051-a966-444e-8b2d-ddbc12e4f70b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:44.839115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-12e47051-a966-444e-8b2d-ddbc12e4f70b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:45.255331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-12e47051-a966-444e-8b2d-ddbc12e4f70b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:45.272176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-12e47051-a966-444e-8b2d-ddbc12e4f70b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1222 microversion: 2.1 time: 0.437390 Nov 24 18:15:45.284476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:45.285092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:45.285414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 18/35] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:44 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1222 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:45.297279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:45.298689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:45.299178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:45.299619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:45.631234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:45.632428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:45.651677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:45.654352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:45.656859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:45.661180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:45.990475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:46.001985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f2d14a8-87d6-46ff-be95-c1a7c91ca77d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.721543 Nov 24 18:15:46.003258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 18/36] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:45 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:46.295553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:46.304798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:46.331252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:46.331772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:46.335648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:46.336307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:46.533109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:46.544363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-40ebbd54-674c-4bc4-9b49-60da8d6d94dd tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.919454 Nov 24 18:15:46.544950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 19/37] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:45 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:46.633675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:46.646891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6b2102e9-ebc4-4690-8f82-4e5fe8cc586a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1218 microversion: 2.1 time: 0.358602 Nov 24 18:15:46.652178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 19/38] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:46 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:46.874890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'create', calling method: .version_select at 0x7f8ba9ab2430>, body: {"keypair": {"name": "tempest-keypair-548127892"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:46.983167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:47.015021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:47.028560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:47.030673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:47.052647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:47.059711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:47.077481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:47.077481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:47.664846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:47.678388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2e86e8d5-c651-4cdb-b00a-4e0efbf45348 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.656710 Nov 24 18:15:47.680770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 20/39] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:47 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:47.693094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:47.697371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:47.709159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:47.711530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:47.713452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:47.714103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:48.268801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:48.284515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-07ab5222-d9db-4a13-a2fd-159206313b3d tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.602502 Nov 24 18:15:48.285786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 21/40] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:47 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:48.290401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:48.291243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:48.311076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:48.311632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:48.315818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:48.316511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:48.383252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:48.410190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:48.414667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:48.423485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3db6ecfc-6275-40f1-9b64-85bd64be93fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1280 microversion: 2.1 time: 0.135694 Nov 24 18:15:48.428059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 22/41] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:48 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1280 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:48.466163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-55ca61c0-00dc-4b77-b270-1fde613dd68c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.905897 Nov 24 18:15:48.477450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 20/42] 10.222.0.53 () {62 vars in 1198 bytes} [Wed Nov 24 18:15:46 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1911 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:15:48.704552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:48.705725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:48.728895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:48.728895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:48.736818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:48.739330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:49.349386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'create', calling method: .version_select at 0x7f8ba8843700>, body: {"keypair": {"name": "tempest-keypair-1247169567"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:49.456682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:49.456682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for user ca31b3f0de0341cd8bea5261d9c90f87 and project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:49.994688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:50.021701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for user ca31b3f0de0341cd8bea5261d9c90f87 and project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:50.064582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-176f4393-f0b5-4748-955e-02298323a0ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.064106 Nov 24 18:15:50.067932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 21/43] 10.222.0.53 () {60 vars in 1157 bytes} [Wed Nov 24 18:15:48 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:50.084472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:50.085109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:50.107352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.107352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.107352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.107352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.207828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:50.215416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-052ec137-8996-4bf8-a59d-17fe0eeabd80 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 1.523708 Nov 24 18:15:50.219692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 23/44] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:48 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:50.309696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-91139330-3664-4012-bb89-cc32ba270c06 req-695d19cd-4a87-497a-8df7-400de3cd31d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b745d4a2-f3c5-40fa-8ebd-cb36682d6977", "tag": "b99dff2d-61b7-450e-9db5-f2b2a2a87439"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:50.314233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:50.314233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:15:50.346803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-91139330-3664-4012-bb89-cc32ba270c06 req-695d19cd-4a87-497a-8df7-400de3cd31d9 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.347658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-91139330-3664-4012-bb89-cc32ba270c06 req-695d19cd-4a87-497a-8df7-400de3cd31d9 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.388038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-91139330-3664-4012-bb89-cc32ba270c06 req-695d19cd-4a87-497a-8df7-400de3cd31d9 service nova] Creating event network-changed:b99dff2d-61b7-450e-9db5-f2b2a2a87439 for instance b745d4a2-f3c5-40fa-8ebd-cb36682d6977 on hv-cinder-80403 Nov 24 18:15:50.388708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-91139330-3664-4012-bb89-cc32ba270c06 req-695d19cd-4a87-497a-8df7-400de3cd31d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 18:15:50.390739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.392393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.397886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.398563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.420335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.compute.rpcapi [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 18:15:50.423888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] Releasing lock "compute-rpcapi-router" {{(pid=116730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 18:15:50.494471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96770d78-83dd-412c-a081-87646fcc2174 None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273005 Nov 24 18:15:50.496098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:50.506508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 24/45] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:50.508435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-98741bfd-c8f0-4981-8c4b-68ca86e8e0ac tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.434181 Nov 24 18:15:50.512452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 22/46] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:50 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:50.515745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:50.517193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:50.528086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.528549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.529349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:50.535162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:50.776372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:50.806666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2eec5461-4400-4bbc-988d-85ebb73244c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.295581 Nov 24 18:15:50.818466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 25/47] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:50 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:51.232328 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:51.232951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:51.245626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:51.248353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:51.249195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:51.249649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:51.542039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:51.542794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:51.560641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:51.567272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:51.571049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:51.571049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:51.964205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:51.985458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4a311834-30f9-418b-a2eb-495bc52d4acf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.756211 Nov 24 18:15:51.989804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 23/48] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:51 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:52.000063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:52.005156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:52.027006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:52.027621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:52.028521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:52.029061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:52.304482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:52.316138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-da104dca-f854-42e7-8f5f-fe13c05f5fc1 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.793546 Nov 24 18:15:52.319356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 26/49] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:51 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:52.516536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:52.524696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-49d59c52-c9e2-4d45-b8ac-b001bbcb1fa8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.533416 Nov 24 18:15:52.538415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 24/50] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:51 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:52.571148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-a5e355e8-6060-4c87-97ad-21adb63e7216 req-2ec1d2ee-9ccf-4d8f-b5a5-23540dd1abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a810e81-9333-4be0-8843-2c9ad48d6933", "tag": "6330daed-e645-481d-a649-d0cdcc9b7c88"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:52.586244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:52.586244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:15:52.586244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-a5e355e8-6060-4c87-97ad-21adb63e7216 req-2ec1d2ee-9ccf-4d8f-b5a5-23540dd1abc1 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:52.586244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-a5e355e8-6060-4c87-97ad-21adb63e7216 req-2ec1d2ee-9ccf-4d8f-b5a5-23540dd1abc1 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:52.618001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-a5e355e8-6060-4c87-97ad-21adb63e7216 req-2ec1d2ee-9ccf-4d8f-b5a5-23540dd1abc1 service nova] Creating event network-changed:6330daed-e645-481d-a649-d0cdcc9b7c88 for instance 9a810e81-9333-4be0-8843-2c9ad48d6933 on hv-cinder-80403 Nov 24 18:15:52.622981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-a5e355e8-6060-4c87-97ad-21adb63e7216 req-2ec1d2ee-9ccf-4d8f-b5a5-23540dd1abc1 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056861 Nov 24 18:15:52.623834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 27/51] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:53.007755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:53.008571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:53.017494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.020087 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.038553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.039021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.337507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:53.338647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:53.346936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.347616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.348589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.349321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.370452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:53.378244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-002044e7-160f-4f89-ab05-7df3984832ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.374734 Nov 24 18:15:53.378827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 25/52] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:53 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:53.545854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:53.546728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:53.554108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.554766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.555773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:53.556354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:53.615017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:53.630349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83b9ef1f-b2a1-48d2-84ac-5add01b8d5d0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.295354 Nov 24 18:15:53.630349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 28/53] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:53 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:53.748906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:53.757684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-57997ffc-1c4a-4232-9d85-2b23a90fa8e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.217173 Nov 24 18:15:53.758224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 26/54] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:53 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:53.875424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1836318069", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8570c77c-6fb6-4161-82b1-39ff9ba5d8f0"}], "security_groups": [{"name": "tempest-securitygroup--1446960268"}], "key_name": "tempest-keypair-548127892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:54.159396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] validate_networks() for [('8570c77c-6fb6-4161-82b1-39ff9ba5d8f0', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:54.395695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:54.396839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:54.403592 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:54.412035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:54.412035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:54.412035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:54.831815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:54.839992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7578de37-0d1f-41e4-8c81-3fb884d60a3a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.448682 Nov 24 18:15:54.845471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 27/55] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:54 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:54.852925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:54.853881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:54.869012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:54.869522 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:54.870829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:54.871339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.328189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:55.337512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-190fe88a-943d-48ef-81c7-c47637611b0e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.490649 Nov 24 18:15:55.339748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 28/56] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:54 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:55.344985 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:55.345967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:55.356195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.356654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.357499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.358066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.616315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:55.617317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:55.617823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:55.618727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:55.619367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:55.629279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.630135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.631172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.631824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.661524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:55.676090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:55.689733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:55.692409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:55.846390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:55.857672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2682ee8e-89b2-4ad3-99b0-67c0999e6306 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.516229 Nov 24 18:15:55.863966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 29/57] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:55 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:55.874629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:55.875322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:55.882958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.883419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.884267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:55.884716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:55.950545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0bc0458c-d480-4138-ac93-9ed69505f795 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.079194 Nov 24 18:15:55.951592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 29/58] 10.222.0.53 () {62 vars in 1187 bytes} [Wed Nov 24 18:15:53 2021] POST /compute/v2.1/servers => generated 402 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 24 18:15:55.957874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1934371286", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09c950fa-a581-4288-9470-630dc2845694"}], "security_groups": [{"name": "tempest-securitygroup--42774852"}], "key_name": "tempest-keypair-1247169567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:56.227971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] validate_networks() for [('09c950fa-a581-4288-9470-630dc2845694', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:15:56.356640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:56.368414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f39c1b0f-378a-491b-8786-c186f392c27b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.501933 Nov 24 18:15:56.371359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 30/59] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:55 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:56.379732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:56.380470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:56.495742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:56.503770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:56.508383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:56.510202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-af0ad1d4-d989-4a1a-aeb7-2f00b12b06cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1281 microversion: 2.20 time: 0.137712 Nov 24 18:15:56.534715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 31/60] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:15:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:15:56.542547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:56.543701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:56.559839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:56.560513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:56.561523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:56.562219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:56.857667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:56.866975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e571055f-7642-4112-827e-453168f0448c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.330524 Nov 24 18:15:56.878233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 32/61] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:56 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:56.943327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-c0ec8099-6cfc-478a-99a9-829de1c85a63 req-933d41e1-eeff-4160-a30c-d5ce07e581b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01eba79d-7c56-4ad4-8a6d-b3084fb1952f", "tag": "877d6e7f-90a3-43eb-baa7-350d90ba0215"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:56.945508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:56.945508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:15:56.957081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-c0ec8099-6cfc-478a-99a9-829de1c85a63 req-933d41e1-eeff-4160-a30c-d5ce07e581b7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:56.958057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-c0ec8099-6cfc-478a-99a9-829de1c85a63 req-933d41e1-eeff-4160-a30c-d5ce07e581b7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:56.985259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-c0ec8099-6cfc-478a-99a9-829de1c85a63 req-933d41e1-eeff-4160-a30c-d5ce07e581b7 service nova] Creating event network-changed:877d6e7f-90a3-43eb-baa7-350d90ba0215 for instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f on hv-cinder-80403 Nov 24 18:15:56.986025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-c0ec8099-6cfc-478a-99a9-829de1c85a63 req-933d41e1-eeff-4160-a30c-d5ce07e581b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 18:15:56.987326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:56.987910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:56.988829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:56.989326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:56.999470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.compute.rpcapi [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 18:15:57.001193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] Releasing lock "compute-rpcapi-router" {{(pid=116731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 18:15:57.041146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a004be6a-2ef5-4a4e-b116-23bcfe89fd0a None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155670 Nov 24 18:15:57.043703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 33/62] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:57.055485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:57.056427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:57.066700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.067976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.069594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.070230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.160297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:57.161307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:57.161796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:57.162225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:57.162641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:57.171667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.173585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.174698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.175361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.201735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for project 323752ad15674bad99bd523cbe98c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:57.207621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for user ca31b3f0de0341cd8bea5261d9c90f87 and project 323752ad15674bad99bd523cbe98c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:57.227425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:15:57.230359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:15:57.408920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-022453f7-e7d7-44cb-bf5c-51db0b2bab17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.455212 Nov 24 18:15:57.412004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 30/63] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:55 2021] POST /compute/v2.1/servers => generated 400 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:15:57.424756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:57.427213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:57.462375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.467554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.476617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.477346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.585465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:57.593197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df5e654a-e2d7-4054-8bd8-0086286404b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.547306 Nov 24 18:15:57.593795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 34/64] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:57 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:57.607693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e228f9d0-8f89-4ee3-b7c2-750a641f9d82 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:57.608690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e228f9d0-8f89-4ee3-b7c2-750a641f9d82 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:57.686416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e228f9d0-8f89-4ee3-b7c2-750a641f9d82 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:57.704051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e228f9d0-8f89-4ee3-b7c2-750a641f9d82 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1238 microversion: 2.1 time: 0.100029 Nov 24 18:15:57.704051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 35/65] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:57.723376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:57.727820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:57.738051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.741704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.742706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.743265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.864696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:57.876014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:57.881406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:57.881406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3ad088a5-f74d-406a-b8f7-f86c6fe84c9d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1285 microversion: 2.20 time: 0.167226 Nov 24 18:15:57.881406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 36/66] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:15:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:15:57.896036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:57.896828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:57.907153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.907153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:57.907449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:57.907897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:58.093822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:58.119968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-16aa68f0-ab2c-4f56-8e33-159827dc30d4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.706459 Nov 24 18:15:58.121033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 31/67] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:57 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:58.198644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:58.206635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9db7f544-07dc-432f-bad7-ac83e63ba19a tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.318732 Nov 24 18:15:58.207208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 37/68] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:57 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:58.611376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:58.612064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:58.620510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:58.623226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:58.624418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:58.627249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:58.717370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0923b0ef-3e3e-4370-b59c-fd8d6af79dda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:58.718017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0923b0ef-3e3e-4370-b59c-fd8d6af79dda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:58.804417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0923b0ef-3e3e-4370-b59c-fd8d6af79dda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:58.813217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0923b0ef-3e3e-4370-b59c-fd8d6af79dda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1238 microversion: 2.1 time: 0.099280 Nov 24 18:15:58.815079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 38/69] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:58.830625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:58.843098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-37632619-ac10-42cf-b1e4-63def2c7647c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.235209 Nov 24 18:15:58.845979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 32/70] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:58 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:58.899290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:58.899874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:58.911615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:58.912137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:58.913014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:58.915541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:58.998218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.008041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.010306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.012239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d2513c5e-9b94-4498-9080-d959bd35d5c0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1341 microversion: 2.20 time: 0.116769 Nov 24 18:15:59.024260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 39/71] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:15:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1341 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:15:59.062658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-b796abf6-4948-448e-a878-131a5a0fe65b req-823bb55c-9077-4252-8ab3-245a583d171e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e99700-926e-462b-8a89-0775c74dd646", "tag": "61bdcb5e-0080-4d16-9417-4fd71e519487"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:59.065599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:59.065599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:15:59.073805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-b796abf6-4948-448e-a878-131a5a0fe65b req-823bb55c-9077-4252-8ab3-245a583d171e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.074413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-b796abf6-4948-448e-a878-131a5a0fe65b req-823bb55c-9077-4252-8ab3-245a583d171e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.087762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-b796abf6-4948-448e-a878-131a5a0fe65b req-823bb55c-9077-4252-8ab3-245a583d171e service nova] Creating event network-changed:61bdcb5e-0080-4d16-9417-4fd71e519487 for instance 97e99700-926e-462b-8a89-0775c74dd646 on hv-cinder-80403 Nov 24 18:15:59.093401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-b796abf6-4948-448e-a878-131a5a0fe65b req-823bb55c-9077-4252-8ab3-245a583d171e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 Nov 24 18:15:59.096085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 33/72] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:59.137457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:59.138117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:59.145261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.146011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.146991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.147754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.224602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:59.235157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:59.244957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.245565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.246815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.247522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.419686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.428367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df82b618-884f-4992-8479-358376634719 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.295464 Nov 24 18:15:59.430825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 40/73] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:59 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:59.618394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.652687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-559f2044-b9b6-406f-af1d-b59406a23e27 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.433138 Nov 24 18:15:59.656143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 34/74] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:59 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:59.833539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:59.834406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:59.841868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.842316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.843092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.853492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.860617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:59.861145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:15:59.867869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.868897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.869680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:15:59.870937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:15:59.968275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:59.976220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6df049c-70b8-407c-a475-1dd936ffa02d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1290 microversion: 2.1 time: 0.148233 Nov 24 18:15:59.997221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 41/75] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:00.032349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:00.032965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:00.040143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.040593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.041374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.041821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.055225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.065696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8749c9a5-4eb5-4b7e-ac52-0448753b0614 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.209119 Nov 24 18:16:00.067284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 35/76] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:59 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:00.123462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.133262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.134773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.135899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-276022f5-6689-4245-aad3-d294cbad7d7d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1339 microversion: 2.20 time: 0.108366 Nov 24 18:16:00.136437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 42/77] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:00.445002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:00.445964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:00.453990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.455177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.456202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.456705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.670719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:00.671442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:00.686875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.689916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.691523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:00.693639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:00.789725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.798802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c430799-9d57-4df1-8b95-9e11a94abb6b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.357609 Nov 24 18:16:00.799387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 36/78] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:00 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:00.943769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:00.951947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ada23c4c-8461-4db3-8523-d5e58274c2c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.285428 Nov 24 18:16:00.953450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 43/79] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:00 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:00.994470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:00.995077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:01.001720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.002196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.003013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.003447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.083510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:01.084278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:01.096159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.098631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:01.101699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.104389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.105459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.107957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4d613925-0363-4e33-9892-e191a18ea09f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1296 microversion: 2.1 time: 0.117477 Nov 24 18:16:01.127280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 37/80] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:01.156817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:01.156817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:01.165958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.170256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.174697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.176672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.488539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:01.496266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4fee0efb-64de-4612-b4c7-94a80ab55e82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.416466 Nov 24 18:16:01.502476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 44/81] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:01 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:01.669251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:01.683537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:01.685174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:01.686276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-256a782e-8818-4f30-ab36-35ae1312a6e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.535922 Nov 24 18:16:01.696896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 38/82] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:01.782561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-334aab44-397c-4fe1-addd-2519cfd81420 req-65e05af9-003e-4f63-a257-dbf1fbfdfa37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:01.784124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:01.784124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:01.803130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-334aab44-397c-4fe1-addd-2519cfd81420 req-65e05af9-003e-4f63-a257-dbf1fbfdfa37 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.803579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-334aab44-397c-4fe1-addd-2519cfd81420 req-65e05af9-003e-4f63-a257-dbf1fbfdfa37 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.815977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:01.817442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:01.835985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.837523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.841070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.843030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.856552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-334aab44-397c-4fe1-addd-2519cfd81420 req-65e05af9-003e-4f63-a257-dbf1fbfdfa37 service nova] Creating event network-changed:644fba12-d45b-488a-b7aa-07835df6583b for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 on hv-cinder-80403 Nov 24 18:16:01.893570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-334aab44-397c-4fe1-addd-2519cfd81420 req-65e05af9-003e-4f63-a257-dbf1fbfdfa37 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092131 Nov 24 18:16:01.900658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 45/83] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:01.973403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:01.975570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:01.992855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.993365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:01.996754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:01.997449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.339631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:02.348009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-50fd66a5-b7c8-4b44-87ee-f597814824f9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.536403 Nov 24 18:16:02.350875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 39/84] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:01 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:02.363491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:02.364490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:02.388258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:02.388994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.390015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:02.390606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.473399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:02.487065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0a27508a-6b4e-48d4-9242-6f12a9f6287c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.518177 Nov 24 18:16:02.489928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 46/85] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:01 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:02.710500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-2ac2da5a-ae81-43d1-ab35-b5454134c6a8 req-74a83392-39ce-4ecd-9acf-c9f9c96e62fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a810e81-9333-4be0-8843-2c9ad48d6933", "name": "network-vif-plugged", "status": "completed", "tag": "6330daed-e645-481d-a649-d0cdcc9b7c88"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:02.712348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:02.712348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:02.723124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-2ac2da5a-ae81-43d1-ab35-b5454134c6a8 req-74a83392-39ce-4ecd-9acf-c9f9c96e62fa service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:02.723485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-2ac2da5a-ae81-43d1-ab35-b5454134c6a8 req-74a83392-39ce-4ecd-9acf-c9f9c96e62fa service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.741570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-2ac2da5a-ae81-43d1-ab35-b5454134c6a8 req-74a83392-39ce-4ecd-9acf-c9f9c96e62fa service nova] Creating event network-vif-plugged:6330daed-e645-481d-a649-d0cdcc9b7c88 for instance 9a810e81-9333-4be0-8843-2c9ad48d6933 on hv-cinder-80403 Nov 24 18:16:02.762982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-2ac2da5a-ae81-43d1-ab35-b5454134c6a8 req-74a83392-39ce-4ecd-9acf-c9f9c96e62fa service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271168 Nov 24 18:16:02.765613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 47/86] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:02.786793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:02.788138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:02.806877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:02.809239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.811698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:02.812442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:02.999669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:03.009359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-257bb96b-02ea-4167-8a94-6389872f1bfa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.650918 Nov 24 18:16:03.010045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 40/87] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:03.025222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:03.026017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:03.035196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.038517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.039734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.045214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.491542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:03.514562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:03.519954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:03.519954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3d3d6354-01e6-4c11-b12e-0c00862156d5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.508313 Nov 24 18:16:03.535081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 41/88] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:03.546609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:03.550148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:03.568373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.571226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.572236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.572817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.648106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:03.658097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6f090cd3-1f1f-4673-9228-157f791bea71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.889935 Nov 24 18:16:03.664380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 48/89] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:02 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:03.697290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:03.697290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:03.709039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.709737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.710701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:03.711490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:03.995632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.003435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-623d1086-7dc4-48b1-88c2-4e203adda134 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.464676 Nov 24 18:16:04.004733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 42/90] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:03 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:04.019532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-03a890fa-eda9-4630-b66b-21a8073edfdd req-b0de3d6c-0caf-4afe-8778-6496956c8bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a308b4d-3cdc-4213-82f2-e95a18edd2e0", "tag": "616ff240-e2a3-4060-827a-0a4cfb95f41a"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:04.022089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:04.022089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:16:04.029673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-03a890fa-eda9-4630-b66b-21a8073edfdd req-b0de3d6c-0caf-4afe-8778-6496956c8bca service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.030930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-03a890fa-eda9-4630-b66b-21a8073edfdd req-b0de3d6c-0caf-4afe-8778-6496956c8bca service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.045800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-03a890fa-eda9-4630-b66b-21a8073edfdd req-b0de3d6c-0caf-4afe-8778-6496956c8bca service nova] Creating event network-changed:616ff240-e2a3-4060-827a-0a4cfb95f41a for instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 on hv-cinder-80403 Nov 24 18:16:04.052308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-03a890fa-eda9-4630-b66b-21a8073edfdd req-b0de3d6c-0caf-4afe-8778-6496956c8bca service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037390 Nov 24 18:16:04.053511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 43/91] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:04.059641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:04.060645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:04.071226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.071226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.071226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.071226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.146653 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.155451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b99dce65-386a-498d-af45-b519a339e052 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.475350 Nov 24 18:16:04.166836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 49/92] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:03 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:04.309966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.320296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f2fd4eaa-fdfd-42e9-8796-e381820d3a4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.263307 Nov 24 18:16:04.320296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 44/93] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:04.547432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:04.554597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:04.567696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.568409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.569414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.570025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.683683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:04.684875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:04.692441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.693038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.693939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.694465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.740913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.749189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.750960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.752255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-40bf9b03-6d24-4f65-bb3b-03df1e2aff25 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.215048 Nov 24 18:16:04.768484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 50/94] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:04.799009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-b722c75d-9e37-469a-bb69-037d8feaec20 req-8bbb1c16-e4b1-4030-b610-fdb910076e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b745d4a2-f3c5-40fa-8ebd-cb36682d6977", "name": "network-vif-plugged", "status": "completed", "tag": "b99dff2d-61b7-450e-9db5-f2b2a2a87439"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:04.800956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:04.800956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:04.810686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-b722c75d-9e37-469a-bb69-037d8feaec20 req-8bbb1c16-e4b1-4030-b610-fdb910076e00 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:04.811056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-b722c75d-9e37-469a-bb69-037d8feaec20 req-8bbb1c16-e4b1-4030-b610-fdb910076e00 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:04.823847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-b722c75d-9e37-469a-bb69-037d8feaec20 req-8bbb1c16-e4b1-4030-b610-fdb910076e00 service nova] Creating event network-vif-plugged:b99dff2d-61b7-450e-9db5-f2b2a2a87439 for instance b745d4a2-f3c5-40fa-8ebd-cb36682d6977 on hv-cinder-80403 Nov 24 18:16:04.830163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-b722c75d-9e37-469a-bb69-037d8feaec20 req-8bbb1c16-e4b1-4030-b610-fdb910076e00 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Nov 24 18:16:04.831138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 51/95] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:16:04.970275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:04.987922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-050b1cb3-8300-4786-801e-0f827ce146c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.311306 Nov 24 18:16:04.988751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 45/96] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:04 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:05.021563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:05.022294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:05.028192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.028629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.029449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.030171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.172575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:05.173193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:05.179345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.179922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.180620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.181053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.260112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:05.268120 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dd0d83b1-60c4-4254-89a1-281bcb0767f3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.251109 Nov 24 18:16:05.268693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 52/97] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:05 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:05.342936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:05.346367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:05.362231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.362686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.367382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.369043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.399560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:05.407895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3aa2d036-a9db-466f-b950-e070cada9acb tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1314 microversion: 2.1 time: 0.239255 Nov 24 18:16:05.408480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 46/98] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:05 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:05.549697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:05.571814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4db93e32-8996-41a5-94ec-935a299c0f6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.240539 Nov 24 18:16:05.573613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 53/99] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:05.774883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:05.775699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:05.785453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.785647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.786690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:05.787357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:05.987376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:05.998246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.005157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:06.006330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:06.013311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.014515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9fe82ab4-aca8-44a4-a37b-46649451d53c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.246728 Nov 24 18:16:06.021798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 47/100] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:06.023437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.023984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.024840 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.025403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.203621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.210877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-54d06b2f-111e-43f5-8d1c-ad4c3e4d99c8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.209296 Nov 24 18:16:06.211446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 54/101] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:06 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:06.284121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:06.284713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:06.290962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.291413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.292193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.292735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.425227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:06.425928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:06.435257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.439216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.439216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.439216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.473742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.482609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a12519df-f115-4e96-9c71-2533eedd08a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1318 microversion: 2.1 time: 0.202126 Nov 24 18:16:06.483191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 48/102] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:06 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:06.589381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:06.590290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:06.598327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.599009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.600109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.600937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.625421 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.632995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d89a6254-fb6d-431d-ac7b-40d9fda23b29 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1501 microversion: 2.1 time: 0.211728 Nov 24 18:16:06.638435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 55/103] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:06 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:06.759309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:06.766721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d34dd48-9e74-447e-91c5-077784497eca tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.181126 Nov 24 18:16:06.767369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 49/104] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:06.851279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e99700-926e-462b-8a89-0775c74dd646", "name": "network-vif-plugged", "status": "completed", "tag": "61bdcb5e-0080-4d16-9417-4fd71e519487"}, {"server_uuid": "01eba79d-7c56-4ad4-8a6d-b3084fb1952f", "name": "network-vif-plugged", "status": "completed", "tag": "877d6e7f-90a3-43eb-baa7-350d90ba0215"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:06.853080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:06.853080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:06.861345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:06.861804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:06.875291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] Creating event network-vif-plugged:61bdcb5e-0080-4d16-9417-4fd71e519487 for instance 97e99700-926e-462b-8a89-0775c74dd646 on hv-cinder-80403 Nov 24 18:16:06.875888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] Creating event network-vif-plugged:877d6e7f-90a3-43eb-baa7-350d90ba0215 for instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f on hv-cinder-80403 Nov 24 18:16:06.882245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-649e9853-8247-4eac-ad42-5241578f8d55 req-6277f7eb-326b-437c-8532-2dede594ada9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034508 Nov 24 18:16:06.886059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 56/105] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:07.038928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:07.039540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:07.046400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.047671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.048491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.049178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.230636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:07.233589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:07.244592 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.247144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.248710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.251496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.298070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.317503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.318754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.323343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-01abc93f-47d3-4788-9d87-998dfb4b5a53 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.288833 Nov 24 18:16:07.324427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 50/106] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:07.483314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.492015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e3593d6c-dc39-435d-80d4-283040d7eed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.267682 Nov 24 18:16:07.513988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 57/107] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:07 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:07.514123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:07.514123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:07.516963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.517410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.518230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.518668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.719372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.727761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-802612e4-e494-47b5-a91a-42b4a52e9d38 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1509 microversion: 2.1 time: 0.232179 Nov 24 18:16:07.728319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 51/108] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:07 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:07.784695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:07.785295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:07.791959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.792641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.793579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:07.794180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:07.941201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:07.948583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-09a370cf-772b-4c60-906f-1c34173aa454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.168545 Nov 24 18:16:07.949206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 58/109] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:08.343139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:08.344725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:08.351780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.352556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.357947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.357947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.500987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:08.509084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:08.510602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:08.511685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-660987e9-c1fc-4b8c-a2d7-baefae3a2169 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.172806 Nov 24 18:16:08.512243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 52/110] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:08.527438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:08.528094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:08.534239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.542284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.542284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.542284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.693815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:08.701085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c02a19fe-25a7-487d-9914-6086a394df2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1322 microversion: 2.1 time: 0.177292 Nov 24 18:16:08.701860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 59/111] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:08 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:08.724484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "361a57af-256f-4908-bb87-4e21bf647681"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:08.725954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:08.735623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.736323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.739119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.739119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.966135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:08.966742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:08.973274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.973719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:08.974518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:08.974948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.159973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:09.159973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c851e710-66ae-4b2c-bce6-6d79674850f5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.164115 Nov 24 18:16:09.159973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 60/112] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:09.529340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:09.530002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:09.535702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.536147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.536903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.537373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.673431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:09.684434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:09.692376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:09.692376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d93b9c73-a28a-4081-808c-ad5250f0cd69 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.165669 Nov 24 18:16:09.692376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 61/113] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:09.721639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:09.725410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:09.735725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.736259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.738218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.739030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.898001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:09.905417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4199d5e1-3089-4e8a-a441-f9da2bc36a68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1516 microversion: 2.1 time: 0.190843 Nov 24 18:16:09.906296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 62/114] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:09 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:09.911090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efc169b4-4cfa-414b-8e36-c80de9604eae"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:09.912203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:09.917916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.918373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:09.921598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:09.921598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.558469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-11d3ab60-e358-469d-9ecc-27343eade3c9 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "POST /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.839464 Nov 24 18:16:10.561937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 53/115] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:16:08 2021] POST /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933/os-volume_attachments => generated 194 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:16:10.582065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:10.590747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:10.592876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.593359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.594868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.595301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.619458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'flavor' on Instance uuid 97e99700-926e-462b-8a89-0775c74dd646 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:16:10.825299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bab39bc5-e538-4353-9eda-3d7f7e5fd1f8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917477 Nov 24 18:16:10.825851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 63/116] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:16:09 2021] POST /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:10.831722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:10.832410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:10.838984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.839424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.840199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.840625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.922267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2f6eb07c-c72a-43b2-be62-706ef44e0d84 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646/action" status: 200 len: 32 microversion: 2.1 time: 0.348063 Nov 24 18:16:10.922975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 54/117] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:10 2021] POST /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:10.930900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:10.931597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:10.939277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.939945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.941120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:10.941387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:10.988376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:10.996194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5085af7e-98d3-46bb-b2aa-30a62d5fcbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.169003 Nov 24 18:16:11.003398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 64/118] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:11.008085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:11.009404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:11.015128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:11.015789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:11.016862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:11.016972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:11.104393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:11.113486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:11.115027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:11.116138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-035e8936-8826-4951-adc5-1a3ac2db00b4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.191856 Nov 24 18:16:11.116890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 55/119] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:11.178214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:11.185367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6fc0aac-03af-4a4c-b0a4-0b750e0b6297 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.180953 Nov 24 18:16:11.188232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 65/120] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:11 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:11.905229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-0b91eebf-346c-4f0e-befd-aef37e3e77a7 req-7bb92b7d-b341-4100-9a06-76ead5cd465c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "name": "network-vif-plugged", "status": "completed", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:11.908486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:11.908486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:16:11.915509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-0b91eebf-346c-4f0e-befd-aef37e3e77a7 req-7bb92b7d-b341-4100-9a06-76ead5cd465c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:11.915951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-0b91eebf-346c-4f0e-befd-aef37e3e77a7 req-7bb92b7d-b341-4100-9a06-76ead5cd465c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:11.929008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-0b91eebf-346c-4f0e-befd-aef37e3e77a7 req-7bb92b7d-b341-4100-9a06-76ead5cd465c service nova] Creating event network-vif-plugged:644fba12-d45b-488a-b7aa-07835df6583b for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 on hv-cinder-80403 Nov 24 18:16:11.940369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-0b91eebf-346c-4f0e-befd-aef37e3e77a7 req-7bb92b7d-b341-4100-9a06-76ead5cd465c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038318 Nov 24 18:16:11.940982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 56/121] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:12.013917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:12.015126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:12.022380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.023150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.023946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.024491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.135191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:12.135887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:12.143663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.146042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.147035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.147638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.186379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:12.195785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d736468-ed45-4c8a-a8fd-7d81025b6422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.185287 Nov 24 18:16:12.197628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 66/122] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:12.202677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:12.203458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:12.209953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.210636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.211768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:12.212377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:12.296370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:12.305653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:12.307871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:12.308967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9e7c618d-def2-4b40-9125-2574d1fca0f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.178203 Nov 24 18:16:12.309532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 57/123] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:12.349720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:12.357354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-16e7ea79-a7a4-4115-ba62-f424a5888c55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.158545 Nov 24 18:16:12.357966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 67/124] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:12 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:13.211917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:13.215415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:13.218768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.219206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.220655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.221085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.327437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:13.328034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:13.334820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.335263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.336036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.336465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.364257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:13.374104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef4b8402-6a04-4ef7-8597-984beb3458ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.165618 Nov 24 18:16:13.375353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 58/125] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:13.381821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:13.382429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:13.389327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.389743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.390561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.390993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.502805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:13.511011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:13.512489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:13.513801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4b0199a8-a956-4856-b2fc-499fdacd9d67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.189961 Nov 24 18:16:13.514695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 68/126] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:13.538644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:13.543688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6000652b-fd03-43e7-8116-3a7d01e07493 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.165267 Nov 24 18:16:13.544694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 59/127] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:13 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:13.956285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-5a359b43-fc40-424c-944f-051dbafdee96 req-04f18504-dd73-4077-aaf2-4b42c0b067b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a308b4d-3cdc-4213-82f2-e95a18edd2e0", "name": "network-vif-plugged", "status": "completed", "tag": "616ff240-e2a3-4060-827a-0a4cfb95f41a"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:13.957922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:13.957922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:13.964890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-5a359b43-fc40-424c-944f-051dbafdee96 req-04f18504-dd73-4077-aaf2-4b42c0b067b7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:13.965338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-5a359b43-fc40-424c-944f-051dbafdee96 req-04f18504-dd73-4077-aaf2-4b42c0b067b7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:13.976319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-5a359b43-fc40-424c-944f-051dbafdee96 req-04f18504-dd73-4077-aaf2-4b42c0b067b7 service nova] Creating event network-vif-plugged:616ff240-e2a3-4060-827a-0a4cfb95f41a for instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 on hv-cinder-80403 Nov 24 18:16:13.981108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-5a359b43-fc40-424c-944f-051dbafdee96 req-04f18504-dd73-4077-aaf2-4b42c0b067b7 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028967 Nov 24 18:16:13.981911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 69/128] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:14.391783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:14.393732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:14.399732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.400367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.401601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.402762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.533449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:14.534168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:14.546300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.546748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.547521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.548556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.653748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:14.661660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-feebf07b-5736-4dcc-815e-57ccdcac3a63 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.273736 Nov 24 18:16:14.662807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 60/129] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:14.667847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:14.670598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:14.678392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.678517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.679377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:14.680141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:14.728871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:14.737871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:14.739377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:14.740491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7d519c00-4d94-4dc2-a057-ca13745e693c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.212295 Nov 24 18:16:14.741375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 70/130] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:14.824132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:14.831752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6c5b24d6-5747-4a13-8d05-00af458826aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.167945 Nov 24 18:16:14.832751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 61/131] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:14 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:15.679223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:15.679909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:15.685937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.690718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:15.691531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.691964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:15.758973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:15.759571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:15.766176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.766643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:15.768001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.768421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:15.914467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:15.916365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:15.924432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-876316f5-89b1-4e3a-9e4c-e2fe88d26b88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1362 microversion: 2.1 time: 0.249007 Nov 24 18:16:15.925080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 71/132] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:15.925474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:15.927276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:15.928386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8b1557de-1764-42ac-9d54-d3750447819d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1407 microversion: 2.20 time: 0.173551 Nov 24 18:16:15.928937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 62/133] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:15.943496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:15.944155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:15.950237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.950667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:15.951454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:15.953032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:16.170146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:16.174131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9fc3a0d4-4b16-4bc1-b951-ffdb7caf2e4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.246751 Nov 24 18:16:16.174709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 72/134] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:15 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:16.942813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:16.943417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:16.947043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:16.948308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:16.950088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:16.950544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:16.951333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:16.951772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:16.955099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:16.957341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:16.957341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:16.957543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.092792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:17.100801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2d9e3e20-bc50-4092-bfe2-58b922f53b10 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1548 microversion: 2.1 time: 0.163056 Nov 24 18:16:17.101379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 63/135] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:17.107467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:17.116491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:17.118241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:17.121393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:17.121393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:17.121711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-efbb92bb-f557-439d-91b1-bc1ecd72038e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1598 microversion: 2.20 time: 0.177002 Nov 24 18:16:17.121711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 73/136] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:16:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:16:17.141017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.141526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.143404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.143520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.143596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:17.144021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:17.151059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.159130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.160033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.160485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.254303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-edccb015-aef5-41b0-9e34-436ba23dc7d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138990 Nov 24 18:16:17.255438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 64/137] 10.222.0.53 () {58 vars in 1274 bytes} [Wed Nov 24 18:16:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:16:17.260270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-72c2c6bb-2bb4-4aae-9ecb-4d27c1b39ce3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.120586 Nov 24 18:16:17.260959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 74/138] 10.222.0.53 () {60 vars in 1315 bytes} [Wed Nov 24 18:16:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:17.264002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:17.264634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:17.271232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.271621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.272405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:17.272834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:17.798656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:17.806677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c0005d00-6f2a-4c7c-a712-f415177acd4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.549778 Nov 24 18:16:17.807364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 65/139] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:17 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:18.823719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:18.824233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:18.831261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:18.831714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:18.832495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:18.832925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:18.955648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:18.956639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:18.966862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:18.967251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:18.967997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:18.968430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:19.077196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2cd83028-cad6-43b1-a7ed-8dd88528dbcb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.126443 Nov 24 18:16:19.077753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 66/140] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:18 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:19.084378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-90cd8967-ca30-42f5-9a7d-744ec754e27f req-f1c768e1-9398-4aa3-8591-12ffc55a8147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a308b4d-3cdc-4213-82f2-e95a18edd2e0", "tag": "616ff240-e2a3-4060-827a-0a4cfb95f41a"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:19.086232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:19.086232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:16:19.113007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-90cd8967-ca30-42f5-9a7d-744ec754e27f req-f1c768e1-9398-4aa3-8591-12ffc55a8147 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:19.114950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-90cd8967-ca30-42f5-9a7d-744ec754e27f req-f1c768e1-9398-4aa3-8591-12ffc55a8147 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:19.134514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:19.141916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-90cd8967-ca30-42f5-9a7d-744ec754e27f req-f1c768e1-9398-4aa3-8591-12ffc55a8147 service nova] Creating event network-changed:616ff240-e2a3-4060-827a-0a4cfb95f41a for instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 on hv-cinder-80403 Nov 24 18:16:19.145792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-081a5b5c-54e7-41ec-b2f8-2f5d9a627e54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.325579 Nov 24 18:16:19.148465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 75/141] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:18 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:19.159504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:19.162588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:19.164524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-90cd8967-ca30-42f5-9a7d-744ec754e27f req-f1c768e1-9398-4aa3-8591-12ffc55a8147 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085295 Nov 24 18:16:19.167941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 67/142] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:19.178421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-2a31b52e-7687-4303-bb9f-863cfe243417 req-4164509d-ea58-4ea2-ba75-59244f2de637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:19.180595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:19.181143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:19.182083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:19.182534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:19.182756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:19.182756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:16:19.196614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-2a31b52e-7687-4303-bb9f-863cfe243417 req-4164509d-ea58-4ea2-ba75-59244f2de637 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:19.206768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-2a31b52e-7687-4303-bb9f-863cfe243417 req-4164509d-ea58-4ea2-ba75-59244f2de637 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:19.221786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-2a31b52e-7687-4303-bb9f-863cfe243417 req-4164509d-ea58-4ea2-ba75-59244f2de637 service nova] Creating event network-changed:644fba12-d45b-488a-b7aa-07835df6583b for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 on hv-cinder-80403 Nov 24 18:16:19.240194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-2a31b52e-7687-4303-bb9f-863cfe243417 req-4164509d-ea58-4ea2-ba75-59244f2de637 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070525 Nov 24 18:16:19.245227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 68/143] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:19.331550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-664e9425-7733-4f59-8139-24d521bc9846 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.181630 Nov 24 18:16:19.334890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 76/144] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:19 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:20.089695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:20.098881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:20.122502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.123201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.124289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.124865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.182730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:20.182730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:20.186117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.186566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.187586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.188200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.290016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-480d3058-d41e-4ee4-960e-31d953904479 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.200596 Nov 24 18:16:20.291249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 69/145] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:20 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:20.343267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:20.344406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:20.359927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.363256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.365228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:20.367542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:20.504389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2c1d73cc-5341-42ca-bc00-6fa0bf51fecc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.165535 Nov 24 18:16:20.508481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 70/146] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:20 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:20.599683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:20.611697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c5f5a109-d734-4316-8acd-24a8b2db422b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.449912 Nov 24 18:16:20.625283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 77/147] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:20 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:21.301150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:21.302444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:21.309566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.310031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.310819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.311251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.420956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d54a3128-a6f0-46b2-a900-f8932ab7ac9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.123914 Nov 24 18:16:21.425166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 71/148] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:21 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:21.516153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:21.517102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:21.523963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.524401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.525160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.525587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.623772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-29421ffb-dbae-4d5c-9464-f4b63dce9ddc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.111127 Nov 24 18:16:21.624425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 78/149] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:21 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:21.632547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:21.637867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:21.640284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.640731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.641548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:21.642030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:21.784974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:21.793285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-87248e87-d2c2-40e1-bb6e-2ada70255f2a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.164695 Nov 24 18:16:21.794230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 72/150] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:21 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:22.433222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:22.434229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:22.442251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.442660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.443440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.444001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.530889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fbfae105-fd6c-451a-8b80-973aeae14ba4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.101552 Nov 24 18:16:22.531560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 79/151] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:22 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:22.635368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:22.636277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:22.644403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.644885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.645748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.646208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.754872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c06392e9-5421-404b-9343-2153639e02db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.122893 Nov 24 18:16:22.755513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 73/152] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:22 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:22.811999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:22.812690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:22.819948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.820395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.821170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:22.821599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:22.974296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:22.981738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e1a10958-1c45-4200-953a-8f36160ce9c3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.173790 Nov 24 18:16:22.982437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 80/153] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:22 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:23.588805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:23.588805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:23.588805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:23.588805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:23.590068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:23.590068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:23.635159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3d9aee76-73b2-47e3-81b1-38b172c2f597 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.096083 Nov 24 18:16:23.658824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 74/154] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:23 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:23.765463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:23.766446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:23.773254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:23.773876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:23.774655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:23.775090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:23.870275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6a0bfabf-0b5e-4160-82da-55fc08ff78f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.108168 Nov 24 18:16:23.870836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 81/155] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:23 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:24.000210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:24.001348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:24.008466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.008978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.009779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.010216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.147180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:24.154889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5903e88e-fc2a-4a1f-b29a-4d4aa5a454ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.158728 Nov 24 18:16:24.160730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 75/156] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:23 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:24.329095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:24.330549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:24.337681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.338156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.338945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.339357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.371467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Going to try to terminate instance {{(pid=116731) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:16:24.669217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:24.670418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:24.677306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.677752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.678557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.678999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.683929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df45e7d8-a607-4773-99bf-d2a6f3a97be7 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 204 len: 0 microversion: 2.1 time: 0.358734 Nov 24 18:16:24.684518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 82/157] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:16:24 2021] DELETE /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:16:24.694230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:24.694921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:24.703514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.703967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.705257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.705694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.796356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8741f32-d9b5-46da-af3f-b0ca5db12c64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.131501 Nov 24 18:16:24.797008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 76/158] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:24 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:24.844928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:24.853069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f2fcb9c2-c418-4dd0-bb8d-7f85c727f397 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1553 microversion: 2.1 time: 0.164263 Nov 24 18:16:24.853649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 83/159] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:24 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:24.881487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:24.882528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:24.889394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.889877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.890711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:24.891145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:24.973421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cb918e00-f77c-454c-89fd-ad18ef1e0ca8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.096429 Nov 24 18:16:24.976568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 77/160] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:24 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:25.171965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:25.172607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:25.183869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.183869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.183869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.183869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.521498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:25.528821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fbf1560d-4036-460a-a9d8-eec79233400c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.360367 Nov 24 18:16:25.529504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 84/161] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:25 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:25.808343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:25.809377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:25.816939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.817402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.818337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.818771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.870426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:25.871036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:25.877418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.877901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.878678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.879112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.893992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bb270364-009b-4a80-835d-b2c894aeb43a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.089798 Nov 24 18:16:25.894755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 78/162] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:25 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:25.984645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:25.985990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:25.993362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.995231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:25.995231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:25.995595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:26.025036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:26.032655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b07122d1-93c0-4ca1-9a6f-57d893d079e0 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1553 microversion: 2.1 time: 0.165930 Nov 24 18:16:26.034008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 85/163] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:25 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:26.074486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-99c65465-17a4-4659-bb56-a05413b85f6e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.093747 Nov 24 18:16:26.077683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 79/164] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:25 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:26.546154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:26.547067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:26.554255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:26.554774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:26.555649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:26.556178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:26.693574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:26.700722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-04a89846-12dd-4e52-9204-2e918f2a262b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.158290 Nov 24 18:16:26.704395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 86/165] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:26 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:26.905124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:26.906149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:26.915212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:26.915728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:26.916513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:26.917568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.010683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b030e66b-eb7c-46b1-a284-447d3d70e91d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.109546 Nov 24 18:16:27.013813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 80/166] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:26 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:27.050308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:27.050911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:27.057349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.057819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.058619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.059046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.087128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:27.088143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:27.095050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.095580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.096366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.096800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.184736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb5a2121-af61-4bb6-878e-b8c053e6264e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.101487 Nov 24 18:16:27.188077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 81/167] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:27 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:27.204799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:27.213023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b1ad8fb0-4103-43bc-94ba-0cde11a8cfa5 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1553 microversion: 2.1 time: 0.167023 Nov 24 18:16:27.213582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 87/168] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:27 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:27.724432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:27.724432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:27.726836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.727518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.728900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.729647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.882833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:27.896269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2d8ff47b-6325-45f8-9cc9-65e1b75b5c8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.181589 Nov 24 18:16:27.896942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 82/169] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:27 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:27.951655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-52725ac8-c3df-4399-8613-5288c4a977c6 req-67b3059e-02aa-4afa-9cae-7f6a55003a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a810e81-9333-4be0-8843-2c9ad48d6933", "name": "network-vif-deleted", "tag": "6330daed-e645-481d-a649-d0cdcc9b7c88"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:27.953311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:27.953311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:27.961131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-52725ac8-c3df-4399-8613-5288c4a977c6 req-67b3059e-02aa-4afa-9cae-7f6a55003a31 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:27.961626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-52725ac8-c3df-4399-8613-5288c4a977c6 req-67b3059e-02aa-4afa-9cae-7f6a55003a31 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:27.973070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-52725ac8-c3df-4399-8613-5288c4a977c6 req-67b3059e-02aa-4afa-9cae-7f6a55003a31 service nova] Creating event network-vif-deleted:6330daed-e645-481d-a649-d0cdcc9b7c88 for instance 9a810e81-9333-4be0-8843-2c9ad48d6933 on hv-cinder-80403 Nov 24 18:16:27.978138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-52725ac8-c3df-4399-8613-5288c4a977c6 req-67b3059e-02aa-4afa-9cae-7f6a55003a31 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Nov 24 18:16:27.979018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 88/170] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:28.024037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:28.025542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:28.035968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.036420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.037346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.037813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.141472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a8a52d9a-c263-4072-8015-afba46da17df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.122336 Nov 24 18:16:28.144865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 83/171] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:28 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:28.196886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:28.198501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:28.205163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.205614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.209180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.209180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.230718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:28.231416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:28.239173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.239612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.240382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.240833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.301264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:28.308048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-57256086-1c89-430a-a7cd-027e823343e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.114751 Nov 24 18:16:28.309647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 89/172] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:28 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:28.310284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-969e4201-3c6f-4276-86aa-2ec53a011460 tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1345 microversion: 2.1 time: 0.083369 Nov 24 18:16:28.321319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 84/173] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:28 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:28.921332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:28.921332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:28.935726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.936229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:28.938642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:28.939685 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.078504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:29.086811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4c9f73ca-82eb-489a-9af4-600969bcb971 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.177202 Nov 24 18:16:29.087387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 90/174] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:28 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:29.154423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:29.155336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:29.162602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.163043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.163815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.164237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.254171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ce536fd-b811-47b3-8b3d-5f520136a660 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.103410 Nov 24 18:16:29.257522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 85/175] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:29 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:29.320630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:29.321683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:29.327984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:29.328888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:29.336656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.337113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.338082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.338525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.345218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.346616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.347498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.347983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.399783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:29.400515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:29.401165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lazy-loading 'fault' on Instance uuid 9a810e81-9333-4be0-8843-2c9ad48d6933 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:16:29.437291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-41b1399a-948a-439d-ad95-4e205368f910 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.120135 Nov 24 18:16:29.438034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 91/176] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:29 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:29.457327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a76b4ab7cb44e3ae2422d4d9056864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8008d8625c3949a98af18c6a8eb18a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:29.465186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b421a94c-855c-4cb9-aa2e-28397b3a041e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 200 len: 1350 microversion: 2.1 time: 0.141114 Nov 24 18:16:29.475436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 86/177] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:29 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:30.105194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:30.105921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:30.113238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.113689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.114547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.115019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.262949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:30.269662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:30.269662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:30.275520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.275520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.275520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.275520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.281557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3014e0cb-22f8-401e-9aee-03459a7a140e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.179837 Nov 24 18:16:30.292747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 92/178] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:30 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:30.352307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9c482dd-ee24-4128-9b91-88f9fba34eb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.091353 Nov 24 18:16:30.353054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 87/179] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:30 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:30.448209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:30.449782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:30.457415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.460802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.460802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.460802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.483777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:30.484935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:30.498609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.499063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.500149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.500327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.517441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] HTTP exception thrown: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. Nov 24 18:16:30.518443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Returning 404 to user: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:16:30.519281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cf407f0b-a82c-489b-9f72-dcd2e4058f5c tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 404 len: 111 microversion: 2.1 time: 0.040054 Nov 24 18:16:30.520355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 88/180] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:30 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:16:30.540832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dcf83f37-3303-443d-82ed-06f63f5fe617 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.095596 Nov 24 18:16:30.542925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 93/181] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:30 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:30.637997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:30.638901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:30.645457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.645955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.646845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:30.647280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:30.667154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] HTTP exception thrown: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. Nov 24 18:16:30.667154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Returning 404 to user: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:16:30.667154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9998edbd-ea70-4749-b756-bd277303cbbe tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028558 Nov 24 18:16:30.667154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 89/182] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:16:30 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:16:30.947889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-893652426", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "d880d6ba-107a-4ad6-b8bf-f00c7b39332c"}]}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:31.002368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.network.neutron [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] validate_networks() for [('d880d6ba-107a-4ad6-b8bf-f00c7b39332c', None, None, None, None, None)] {{(pid=116731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:16:31.303056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:31.303845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:31.323951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.326812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.327867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.328295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.493514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:31.500946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2b376b95-7a16-45fe-9229-aa22eabe30d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.205142 Nov 24 18:16:31.502420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 90/183] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:31 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:31.507014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:31.507958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:31.513632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.514108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.514877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.515304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.594917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-91b5921a-fff6-4390-9c7e-07f8c6ca1b52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.090891 Nov 24 18:16:31.596854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 91/184] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:31 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:31.608605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:31.609973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:31.618728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.619368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.621736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.621736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.649155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:16:31.649632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:16:31.651856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:16:31.654100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:16:31.656107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:16:31.667453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.667938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.668977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:31.669409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:31.692112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:16:31.693752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for user 5bf4f94ef33c406f86a393463f4f20c2 and project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:16:31.705172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Going to run 1 instances... {{(pid=116731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:16:31.707195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b5439431-dc7c-4dcc-b8f7-8735bb623457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.108125 Nov 24 18:16:31.709840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 92/185] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:31 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:31.709968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:16:31.845971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5a8cf410-1f88-4d7b-89a1-6cc18434a5fb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901397 Nov 24 18:16:31.851880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 94/186] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:16:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:16:31.857620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-762c8b9e-140b-4357-86f4-63728fcebf92 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:31.858471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-762c8b9e-140b-4357-86f4-63728fcebf92 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:31.930757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-762c8b9e-140b-4357-86f4-63728fcebf92 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:31.938535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-762c8b9e-140b-4357-86f4-63728fcebf92 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1217 microversion: 2.1 time: 0.084897 Nov 24 18:16:31.948276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 93/187] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:31 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:32.140559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:32.141322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.155667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.158437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.159510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.161231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.193624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.wsgi [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] HTTP exception thrown: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. Nov 24 18:16:32.199076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Returning 404 to user: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:16:32.199076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-59841892-cde6-4fa8-92d9-9e674d44abea tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 404 len: 111 microversion: 2.1 time: 0.059277 Nov 24 18:16:32.199076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 95/188] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:16:32 2021] DELETE /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:16:32.206599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:32.208372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] [instance: 9a810e81-9333-4be0-8843-2c9ad48d6933] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.218109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.219575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.220771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.221470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.241781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] HTTP exception thrown: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. Nov 24 18:16:32.243241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] Returning 404 to user: Instance 9a810e81-9333-4be0-8843-2c9ad48d6933 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:16:32.244733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aa80259f-1a2e-4887-8059-57c7d6f56d9e tempest-DeleteServersTestJSON-1828201955 tempest-DeleteServersTestJSON-1828201955-project] 10.222.0.53 "GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933" status: 404 len: 111 microversion: 2.1 time: 0.042842 Nov 24 18:16:32.245493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 94/189] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:32 2021] GET /compute/v2.1/servers/9a810e81-9333-4be0-8843-2c9ad48d6933 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:16:32.518546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:32.521665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.532116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.533112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.534024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.534464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.613170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:32.617085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.634488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.654001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.654001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.654001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.732431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5860628-1845-4aee-8461-93e7ebebb84d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.128799 Nov 24 18:16:32.733512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 95/190] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:32 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:32.738820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:32.740301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.752836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.752836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.752836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.752836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.824734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e912d1d-5bea-425b-ab2c-31229fe871f7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.089615 Nov 24 18:16:32.825375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 96/191] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:32 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:32.901516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:32.912573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2776dd8e-55f9-4b99-93f5-113545cfdc9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.395198 Nov 24 18:16:32.920586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 96/192] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:32 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:32.956858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:32.957794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:32.965626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.966269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:32.967470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:32.968093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.082705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:33.091222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9b70aea8-9d75-4bff-a11f-cdf8315c7948 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1221 microversion: 2.1 time: 0.139172 Nov 24 18:16:33.091897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 97/193] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:32 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:33.743302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:33.744420 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:33.750775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.751252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.753955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.753955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.828806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d973a2d6-c8c2-4167-9cb0-7a587e9e4011 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 14 microversion: 2.1 time: 0.089157 Nov 24 18:16:33.830103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 97/194] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:33 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:33.836807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:33.838443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:33.844853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.846189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.846875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.847315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.919337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-da3e1e98-4b8c-4813-a12c-8ddb6c987ae8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 14 microversion: 2.20 time: 0.086380 Nov 24 18:16:33.920508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 98/195] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:33 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:33.929396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:33.930370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:33.938163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.944930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:33.946359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:33.946966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.110930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:34.111703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:34.118991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.123378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.127800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.127800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.179437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:34.193389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fc644fd2-a92e-422c-9a4a-2ff1a3e39c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.267468 Nov 24 18:16:34.205033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 98/196] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:33 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:34.220853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:34.230010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9ef6adec-4cf3-4182-8df5-0b348959976c tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1269 microversion: 2.1 time: 0.124339 Nov 24 18:16:34.230586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 99/197] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:34 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:34.309828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-956596175", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "6594c41e-91a7-404f-8c3f-f9b100eb0db1"}]}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:34.396681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.network.neutron [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] validate_networks() for [('6594c41e-91a7-404f-8c3f-f9b100eb0db1', None, None, None, None, None)] {{(pid=116731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:16:34.841797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:34.843488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:34.850641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.851305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.852227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.852654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.938573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9524e76-0f37-45a6-9697-526b84f4cd8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 3504 microversion: 2.1 time: 0.101197 Nov 24 18:16:34.940308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 100/198] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:34 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 3504 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:34.947793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:34.948865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:34.958575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.959272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:34.960473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:34.960473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.033475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Flavor limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:16:35.034791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Image limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:16:35.035506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Flavor pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:16:35.036288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Image pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:16:35.037054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:16:35.047898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4eca39a6-3b6e-4358-a409-e3fe5ad3fc9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 7865 microversion: 2.20 time: 0.105847 Nov 24 18:16:35.050118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 101/199] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:34 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 7865 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:16:35.051017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.057855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.057855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.057855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.083255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Getting quotas for project fe058a6b6aa84cb1955a9274cae09e4e. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:16:35.089741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Getting quotas for user b2e05569bfb84e62846e2e0ff5bc1999 and project fe058a6b6aa84cb1955a9274cae09e4e. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:16:35.105981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Going to run 1 instances... {{(pid=116731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:16:35.112195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:16:35.220457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:35.222033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:35.248550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.256555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.262632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7765b515-2aff-4902-986a-f2b788b5de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956522 Nov 24 18:16:35.263550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 99/200] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:16:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:16:35.267512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.274561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.277423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:35.280098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:35.295505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.296482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.300058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.301919 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.440272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:35.449829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0f2ba80e-1840-45f9-be19-bd44b5139da6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1275 microversion: 2.1 time: 0.185035 Nov 24 18:16:35.462717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 100/201] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:35 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:35.468077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-51383622-78fe-4282-a818-47b75d3a5daf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:35.468931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-51383622-78fe-4282-a818-47b75d3a5daf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:35.593011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-51383622-78fe-4282-a818-47b75d3a5daf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:35.603824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-51383622-78fe-4282-a818-47b75d3a5daf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1218 microversion: 2.1 time: 0.139583 Nov 24 18:16:35.609026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 101/202] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:35.663707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:35.675430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-36b57dea-c2b4-4661-b754-e857eed74206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.467821 Nov 24 18:16:35.676390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 102/203] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:35 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:35.951054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:35.952021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:35.969029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.969255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:35.973624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:35.973926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.067822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:36.067822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:36.075090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.077063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.078691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.079961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.096221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-20cee2e6-b9c6-4c7f-8ede-3bf540280a01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 10975 microversion: 2.1 time: 0.147847 Nov 24 18:16:36.098343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 102/204] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:35 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 10975 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:36.212913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ffc45740-9a91-4c16-a2cb-483c3af1db93 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 13652 microversion: 2.20 time: 0.154652 Nov 24 18:16:36.218944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 103/205] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:36 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 13652 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:36.469377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:36.470750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:36.477712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.478451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.479291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.479729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.627220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-705f9a66-34aa-4a1b-b437-3fcbe94e6352 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:36.628220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-705f9a66-34aa-4a1b-b437-3fcbe94e6352 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:36.679105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:36.690557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c2012616-0aa4-49c4-9dea-50d13a3733ff tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.225702 Nov 24 18:16:36.690832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-705f9a66-34aa-4a1b-b437-3fcbe94e6352 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:36.693580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 103/206] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:36 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:36.696698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:36.697537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:36.698254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-705f9a66-34aa-4a1b-b437-3fcbe94e6352 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1218 microversion: 2.1 time: 0.075647 Nov 24 18:16:36.699114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 104/207] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:36 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:36.703889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.704418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.705901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:36.706669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:36.969826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:36.980680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-47837e94-c39b-4432-a605-16ece849cfae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.288148 Nov 24 18:16:36.991874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 104/208] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:36 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:37.109332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:37.111044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:37.118303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.118758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.119553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.120002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.201839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-bcf0ca9a-ccf8-4f99-b8bb-da3ab1917604 req-99979ffb-9c18-4169-9a25-96369ae4d7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0", "tag": "adfbdbfc-1b11-489b-b5e1-9ab0b980464b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:37.205151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:37.205151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:37.205576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-802765e0-4304-4314-aae6-382cfd592b8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 15064 microversion: 2.1 time: 0.099872 Nov 24 18:16:37.210607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 105/209] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:37 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 15064 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:37.233626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:37.234938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:37.244210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-bcf0ca9a-ccf8-4f99-b8bb-da3ab1917604 req-99979ffb-9c18-4169-9a25-96369ae4d7fc service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.244210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-bcf0ca9a-ccf8-4f99-b8bb-da3ab1917604 req-99979ffb-9c18-4169-9a25-96369ae4d7fc service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.252012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.252569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.253363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.253940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.267978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-bcf0ca9a-ccf8-4f99-b8bb-da3ab1917604 req-99979ffb-9c18-4169-9a25-96369ae4d7fc service nova] Creating event network-changed:adfbdbfc-1b11-489b-b5e1-9ab0b980464b for instance 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 on hv-cinder-80403 Nov 24 18:16:37.276622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-bcf0ca9a-ccf8-4f99-b8bb-da3ab1917604 req-99979ffb-9c18-4169-9a25-96369ae4d7fc service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082786 Nov 24 18:16:37.283084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 105/210] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:16:37.364362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5ef7be9-f1cb-4c01-afeb-39eceec474f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 17171 microversion: 2.20 time: 0.135400 Nov 24 18:16:37.366604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 106/211] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:37 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 17171 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:37.708302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:37.708996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:37.716272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.716982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.717661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:37.718290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.718400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:37.719171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.744258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.744709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.745504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:37.745962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:37.828763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:37.867373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-992a19e6-601d-4a30-acd4-02b45eb89b36 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1270 microversion: 2.1 time: 0.129893 Nov 24 18:16:37.867373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 107/212] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:37.926426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:37.933970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dcc2fa2a-3c9d-4735-aa37-fa7c45cfa866 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.230186 Nov 24 18:16:37.934537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 106/213] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:37 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:37.997896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:37.998624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:38.005822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.006563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.013486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.013486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.220604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:38.221942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:38.232492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.232946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.233744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.234833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.311271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:38.330770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1de228f7-7678-45cc-891e-20590c764e8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.325651 Nov 24 18:16:38.330770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 108/214] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:37 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:38.358617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-029ba970-1406-475d-a528-e77371f0bb53 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 18030 microversion: 2.1 time: 0.143958 Nov 24 18:16:38.359761 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 107/215] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:38 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 18030 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:38.377505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:38.378783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:38.388448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.390665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.391658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.392645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.580295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c11001a5-a856-4ec9-baf1-9063607d51cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 17960 microversion: 2.20 time: 0.206796 Nov 24 18:16:38.584417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 109/216] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:38 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 17960 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:38.888925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:38.889618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:38.902635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.903069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.904096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.904520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.951282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:38.952003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:38.960554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.960554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.961424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:38.961907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:38.971055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:38.978327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-22ba1923-a78f-41a6-9939-c88c703c511d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1276 microversion: 2.1 time: 0.095038 Nov 24 18:16:38.979201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 108/217] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:39.178499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:39.186183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a1cb81ec-59b1-476a-8501-e03509d879ca tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.238681 Nov 24 18:16:39.186893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 110/218] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:38 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:39.337683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:39.338243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:39.344330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.344817 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.345886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.346386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.372486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:39.374257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:39.381179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.385384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.386351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.386781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.504089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e02ccc7d-451a-4866-9634-834c1e1319dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 19133 microversion: 2.1 time: 0.136685 Nov 24 18:16:39.504989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 111/219] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:39 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 19133 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:39.519690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:39.532478 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df8b5f3a-1696-4cbf-9d8c-ff21013a8760 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.198271 Nov 24 18:16:39.542142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 109/220] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:39 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:39.592604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:39.593550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:39.600511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.600966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.601741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.602368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.711680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9e0d551-5ab1-4555-a019-cc1347b1dd97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 19446 microversion: 2.20 time: 0.123128 Nov 24 18:16:39.712681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 112/221] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:39 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 19446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:39.936887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-9f43b559-ae29-4739-a53b-f72ad7bf9695 req-cc656498-a244-4669-b81d-d4529caa5893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d89cec0-16f4-478a-b48a-344063683dff", "tag": "a3f010ff-db6e-4dad-aabe-463f75447b86"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:39.939305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:39.939305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:39.946945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-9f43b559-ae29-4739-a53b-f72ad7bf9695 req-cc656498-a244-4669-b81d-d4529caa5893 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:39.948081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-9f43b559-ae29-4739-a53b-f72ad7bf9695 req-cc656498-a244-4669-b81d-d4529caa5893 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:39.960386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-9f43b559-ae29-4739-a53b-f72ad7bf9695 req-cc656498-a244-4669-b81d-d4529caa5893 service nova] Creating event network-changed:a3f010ff-db6e-4dad-aabe-463f75447b86 for instance 0d89cec0-16f4-478a-b48a-344063683dff on hv-cinder-80403 Nov 24 18:16:39.964859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-9f43b559-ae29-4739-a53b-f72ad7bf9695 req-cc656498-a244-4669-b81d-d4529caa5893 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031733 Nov 24 18:16:39.965459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 110/222] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:16:39.996643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:39.997341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:40.004343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.004791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.005589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.006098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.203521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:40.205066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:40.212349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.212953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.213909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.214484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.378422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:40.385877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0b863b5c-8dba-4e9c-ba04-b8d2abc01469 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.186012 Nov 24 18:16:40.386565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 111/223] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:40 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:40.516167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:40.517723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:40.523822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.529476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.529476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.529476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.529888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:40.535245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aaf860bc-cbc9-4ad6-8f21-20773ac218f5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.542453 Nov 24 18:16:40.535827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 113/224] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:40.549717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:40.550437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:40.557598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.558221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.559091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.559594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.616861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f48fe693-7487-4a37-aa56-e83dfa5796cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 20997 microversion: 2.1 time: 0.104503 Nov 24 18:16:40.617691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 112/225] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:40 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 20997 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:40.731924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:40.731924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:40.738655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.739311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.740429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:40.741038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:40.826106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:40.834486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e62bf682-450d-4745-aff6-391cb13865f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.288504 Nov 24 18:16:40.841624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-610ea17d-f1eb-4fb6-a36e-d96faf08330d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 21929 microversion: 2.20 time: 0.120516 Nov 24 18:16:40.844146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 114/226] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:40 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:40.845812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 113/227] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:40 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 21929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:41.405173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:41.406261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:41.416688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.417369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.418593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.420228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.553002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:41.558807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:41.560728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.561397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.562319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.562850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.575421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:41.583739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-58e8dd34-21c2-49c6-9928-1f0ce00051e1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.183676 Nov 24 18:16:41.593336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 115/228] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:41 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:41.630166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:41.631561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:41.637676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.638161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.638978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.639424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.702818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:41.711026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-451f77a2-db2c-4e45-9919-52dc48f02150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.162510 Nov 24 18:16:41.711741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 114/229] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:41.851606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:41.856399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:41.858740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.859179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.859944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:41.860538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:41.995378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:42.003278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c1f45ddb-9c18-46df-bd22-3b86d0bca308 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.155593 Nov 24 18:16:42.003851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 115/230] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:41 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:42.008271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:42.009277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:42.014944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:42.015390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:42.016161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:42.016643 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.545039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9e7eeb51-8d63-4486-b11d-2cd87398a302 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 24743 microversion: 2.1 time: 2.919076 Nov 24 18:16:44.545689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 116/231] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:41 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 24743 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:44.550870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:44.551814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:44.558750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.559803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.560001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.560396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.561103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9bc56c29-45f8-494d-94da-9201b1380947 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 24664 microversion: 2.20 time: 2.555983 Nov 24 18:16:44.563848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 116/232] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:42 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 24664 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:44.568078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:44.569722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:44.580584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.581273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.582103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.582542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.707999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:44.718122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d49ced3-e205-44bf-bf2e-c660b8a87ca9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.171063 Nov 24 18:16:44.718712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 117/233] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:44 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:44.723387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:44.723999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:44.732831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.733524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.734588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:44.735026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:44.737019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:44.746585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d9cc2eb6-5e1b-487d-9db5-8fb90618103e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.183650 Nov 24 18:16:44.747164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 117/234] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:44.881741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:44.889693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42205a2c-3608-487e-9969-5890c43371e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.170000 Nov 24 18:16:44.890461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 118/235] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:44 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:45.556839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:45.559790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:45.568080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.568666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.569336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.569794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.575702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:45.577102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:45.584973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.585609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.586597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.587212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.658526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8d47639e-2134-4eb5-8a15-158bc7b89fb6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 25296 microversion: 2.1 time: 0.105086 Nov 24 18:16:45.662425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 118/236] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:45 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 25296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:45.674479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-49752989-a79f-441e-9fda-7f3c57957b9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 25505 microversion: 2.20 time: 0.102104 Nov 24 18:16:45.675116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 119/237] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:45 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 25505 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:45.736075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:45.737129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:45.744159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.744620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.745413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.745875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.764494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:45.765196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:45.775806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.776466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.777608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.785933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.894907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:45.914971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b54a10d5-3b53-43fe-9a8a-19d8f10b1463 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.183358 Nov 24 18:16:45.915543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 119/238] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:45 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:45.920541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:45.921133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:45.928431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.929381 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.929845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:45.930215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:45.941523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:45.950528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-395eaba0-0ce8-4b3e-9fc0-6c5975441734 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.189879 Nov 24 18:16:45.951557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 120/239] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:46.083306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:46.090547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-85665133-a494-4024-b90b-f074f1e7a8a0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.174062 Nov 24 18:16:46.091220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 120/240] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:45 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:46.669581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:46.670633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:46.678366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.678838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.679635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.680071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.695306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:46.695306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:46.700057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.700509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.701408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.701887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.771610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c57f43e-18cf-4cd0-801e-629b39ee892c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 26183 microversion: 2.1 time: 0.105520 Nov 24 18:16:46.772316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 121/241] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:46 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 26183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:46.803684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-05fe5456-aa45-4774-848a-ddea1a8fc77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 26131 microversion: 2.20 time: 0.115429 Nov 24 18:16:46.804321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 121/242] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:46 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 26131 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:46.933006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:46.933920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:46.941166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.941613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.942505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.942941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.967971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:46.968567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:46.976225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.976954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:46.977727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:46.978172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.103317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:47.112915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-92210ca5-7506-4604-a6c8-2cbca4e7af37 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.183426 Nov 24 18:16:47.122691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 122/243] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:46 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:47.127624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:47.132061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:47.136554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.137042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.138375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.138822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.170804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:47.179132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-06e36a6e-051e-4d22-886d-ea805367d6e3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.215093 Nov 24 18:16:47.179696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 122/244] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:47.286423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:47.293615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-18b70ec3-65d9-488e-8dd3-197db150ba7b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.175714 Nov 24 18:16:47.294478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 123/245] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:47 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:47.625538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-d7a7b94e-945f-4ff0-ab10-06db77e2b977 req-781c1729-451e-4631-8696-a13f48f2b834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0", "name": "network-vif-plugged", "status": "completed", "tag": "adfbdbfc-1b11-489b-b5e1-9ab0b980464b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:47.627601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:47.627601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:47.634859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-d7a7b94e-945f-4ff0-ab10-06db77e2b977 req-781c1729-451e-4631-8696-a13f48f2b834 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.636212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-d7a7b94e-945f-4ff0-ab10-06db77e2b977 req-781c1729-451e-4631-8696-a13f48f2b834 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.645982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-d7a7b94e-945f-4ff0-ab10-06db77e2b977 req-781c1729-451e-4631-8696-a13f48f2b834 service nova] Creating event network-vif-plugged:adfbdbfc-1b11-489b-b5e1-9ab0b980464b for instance 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 on hv-cinder-80403 Nov 24 18:16:47.650545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-d7a7b94e-945f-4ff0-ab10-06db77e2b977 req-781c1729-451e-4631-8696-a13f48f2b834 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028491 Nov 24 18:16:47.653443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 123/246] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:47.785556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:47.786081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:47.791486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.791932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.792721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.793128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.816406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:47.817407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:47.825065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.825519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.826341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:47.826776 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:47.916503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a0014d10-e9ab-4e5b-8acc-fe447543355e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 26917 microversion: 2.1 time: 0.136538 Nov 24 18:16:47.918296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 124/247] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:47 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 26917 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:47.965100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-238d54c9-1d67-4d41-8ddd-2918a7d14f72 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 26868 microversion: 2.20 time: 0.152339 Nov 24 18:16:47.965887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 124/248] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:47 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 26868 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:48.130951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:48.131913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:48.138559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.139216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.140552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.141319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.197609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:48.198690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:48.206832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.207275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.208059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.208491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.290233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:48.303528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-599e00d5-3437-400b-98cf-63bedffe08b2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.176203 Nov 24 18:16:48.304394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 125/249] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:48 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:48.318442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:48.319323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:48.326397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.326894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.327868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.328449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.364061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:48.371615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b93639d-6cce-4e9c-8858-25497d3a423b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.178407 Nov 24 18:16:48.381545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 125/250] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:48.479916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:48.488247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48f0f8f5-3fbb-46f8-9b05-e59d15fe8482 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1522 microversion: 2.1 time: 0.173378 Nov 24 18:16:48.489191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 126/251] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:48 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:48.928092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:48.928881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:48.935012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.935451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.936220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.936646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.978974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:48.980104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:48.994512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.995290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:48.996289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:48.996746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.036000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7931d57-530a-446b-b436-7579e852a4b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 27344 microversion: 2.1 time: 0.111916 Nov 24 18:16:49.036674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 126/252] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:48 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 27344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:49.092536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96a1318c-b22d-4c04-8c4d-e4ba86405839 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 27257 microversion: 2.20 time: 0.117908 Nov 24 18:16:49.093419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 127/253] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:48 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 27257 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:49.324144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:49.325085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:49.334401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.334842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.335698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.336125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.389444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:49.390164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:49.397390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.398144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.398941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.399377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.506295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:49.515677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e9d01f0d-de3a-4fbf-a72c-bcf1ff76e64a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1317 microversion: 2.1 time: 0.196491 Nov 24 18:16:49.524194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 127/254] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:49 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:49.524194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:49.524194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:49.528502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.528944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.529783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.530226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.578255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:49.587706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1af2fcb8-a126-466a-8464-7a17513eaa9a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.202132 Nov 24 18:16:49.588617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 128/255] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:49.665251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-59fd9f0b-5b40-4dd4-8a97-85a84f73c4ec req-ceee4315-9a6e-4786-a9cb-b75a5273c329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d89cec0-16f4-478a-b48a-344063683dff", "name": "network-vif-plugged", "status": "completed", "tag": "a3f010ff-db6e-4dad-aabe-463f75447b86"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:49.667031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:49.667031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:16:49.674554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-59fd9f0b-5b40-4dd4-8a97-85a84f73c4ec req-ceee4315-9a6e-4786-a9cb-b75a5273c329 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.679661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-59fd9f0b-5b40-4dd4-8a97-85a84f73c4ec req-ceee4315-9a6e-4786-a9cb-b75a5273c329 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.684372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:49.686618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-59fd9f0b-5b40-4dd4-8a97-85a84f73c4ec req-ceee4315-9a6e-4786-a9cb-b75a5273c329 service nova] Creating event network-vif-plugged:a3f010ff-db6e-4dad-aabe-463f75447b86 for instance 0d89cec0-16f4-478a-b48a-344063683dff on hv-cinder-80403 Nov 24 18:16:49.692289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-59fd9f0b-5b40-4dd4-8a97-85a84f73c4ec req-ceee4315-9a6e-4786-a9cb-b75a5273c329 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030625 Nov 24 18:16:49.693140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 129/256] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:49.693269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b9116e86-87ad-48cf-a042-e80a2304dd01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1502 microversion: 2.1 time: 0.174590 Nov 24 18:16:49.694034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 128/257] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:49 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:49.711946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:49.713595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:49.725699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.726460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.727420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:49.728125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:49.868543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:49.875821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0dd72329-ce80-46a1-a38e-6c9e7cd989d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1516 microversion: 2.1 time: 0.168754 Nov 24 18:16:49.877044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 130/258] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:50.054333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:50.055447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:50.061881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.062287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.063062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.063499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.104630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:50.105610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:50.112287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.113134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.114021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.114645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.162694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1acbf097-3390-4b53-aa0b-7bad8f8f14dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 27642 microversion: 2.1 time: 0.112062 Nov 24 18:16:50.163587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 129/259] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:50 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 27642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:50.468568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-069306c0-6399-4a33-8199-d0b143f065ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 27670 microversion: 2.20 time: 0.367845 Nov 24 18:16:50.469248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 131/260] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:50 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 27670 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:50.533455 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:50.546201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:50.551514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.551986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.552796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.553198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.606131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:50.607501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:50.616449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.617461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.618573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.619466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.714942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:50.722633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-616d748b-4d36-48a8-9a7e-8a565588caa6 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1507 microversion: 2.1 time: 0.193625 Nov 24 18:16:50.723276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 130/261] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:50 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:50.740167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efc169b4-4cfa-414b-8e36-c80de9604eae"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:50.741223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:50.747327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.747519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.748287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:50.748710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:50.763134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:50.771105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-549351a4-0dfa-4ba7-80f6-e99f616d69a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.170231 Nov 24 18:16:50.771814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 132/262] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:50 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:51.174340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:51.175346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.182181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.182713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.183680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.184187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.237814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.wsgi [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Invalid volume: volume efc169b4-4cfa-414b-8e36-c80de9604eae is already attached to instances: b745d4a2-f3c5-40fa-8ebd-cb36682d6977 Nov 24 18:16:51.238423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 400 to user: Invalid volume: volume efc169b4-4cfa-414b-8e36-c80de9604eae is already attached to instances: b745d4a2-f3c5-40fa-8ebd-cb36682d6977 {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:16:51.239251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b6421aa-7358-4b2c-a263-4efe0933ec21 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.503584 Nov 24 18:16:51.239827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 131/263] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:16:50 2021] POST /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0/os-volume_attachments => generated 174 bytes in 505 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 18:16:51.286983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95367995-274c-4b77-8dac-0472f1d74562 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 27843 microversion: 2.1 time: 0.116054 Nov 24 18:16:51.287881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 133/264] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:51 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 27843 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:51.323886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:51.324382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.335553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.335553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.335553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.336263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.475344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.objects.instance [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lazy-loading 'services' on Instance uuid b745d4a2-f3c5-40fa-8ebd-cb36682d6977 {{(pid=116731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:16:51.481276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:51.482902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.490706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.491392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.492182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.492620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.582350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e7248e1d-66f7-4d8b-86f8-ec111d01bbd1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 27912 microversion: 2.20 time: 0.105217 Nov 24 18:16:51.583056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 134/265] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:51 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 27912 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:51.707159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:51.708183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.718291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2e4638b1-4102-4f9d-ac92-ae411cfbebb3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments/efc169b4-4cfa-414b-8e36-c80de9604eae" status: 202 len: 0 microversion: 2.1 time: 0.397964 Nov 24 18:16:51.718720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.719380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 132/266] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:16:51 2021] DELETE /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments/efc169b4-4cfa-414b-8e36-c80de9604eae => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:51.719613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.720583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.721023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.732824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:51.739741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.749686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.750160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.750954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.752058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.766520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'flavor' on Instance uuid 01eba79d-7c56-4ad4-8a6d-b3084fb1952f {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:16:51.784334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c8db52e6-9903-4f7e-a0f7-c2d6f1ac1e82 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059931 Nov 24 18:16:51.785056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 133/267] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:16:51 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:51.793173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:51.793799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:51.800201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.800648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.801679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:51.802148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:51.945631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:51.952792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8a952fd9-2683-4542-a950-eb951e1110d0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1318 microversion: 2.1 time: 0.163190 Nov 24 18:16:51.953352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 134/268] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:52.098291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-20351db1-b0e5-4f7a-9a9e-9fd3fd25c076 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action" status: 200 len: 32 microversion: 2.1 time: 0.396000 Nov 24 18:16:52.098893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 135/269] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:51 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action => generated 32 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:16:52.107710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:52.108312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:52.114656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.115045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.115811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.116244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.249085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:52.257961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6e3ca236-d2d6-4c7e-a56f-6d6b11a69f25 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.153836 Nov 24 18:16:52.258667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 135/270] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:52.300422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:52.301663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:52.309007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.312568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.312568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.312568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.420119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9f393987-139f-493b-bdda-600f5fa8ef09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28129 microversion: 2.1 time: 0.124555 Nov 24 18:16:52.420775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 136/271] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:52 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28129 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:52.596313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:52.597294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:52.604711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.605148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.606018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.606442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.714690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-80553940-5737-483e-9fdc-526c6e14d5fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28141 microversion: 2.20 time: 0.123850 Nov 24 18:16:52.718973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 136/272] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:52 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28141 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:52.797144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:52.798595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:52.806227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.806637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.807453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.807885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.839327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3d29b01b-f44d-476c-b183-c58ad2b76b6a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Nov 24 18:16:52.839888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 137/273] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:16:52 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:52.969317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:52.970203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:52.977391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.977859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:52.978630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:52.979053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.122582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:53.132046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-45dbfa74-9621-45b5-b417-bd71c9ed5738 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1506 microversion: 2.1 time: 0.165862 Nov 24 18:16:53.133007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 137/274] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:53.275955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:53.276685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:53.283289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.283900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.284750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.285275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.435481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:53.436513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:53.436976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:53.444667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cde372e2-4823-468c-82df-e9e7f8b79ae5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.172879 Nov 24 18:16:53.445155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 138/275] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:53.448431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.450982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.452737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.453253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.564682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2a7153c8-0a6d-4d35-95f0-13e460490eed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28246 microversion: 2.1 time: 0.134964 Nov 24 18:16:53.565714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 138/276] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:53 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:53.727710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:53.730485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:53.735049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.735774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.736553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.736993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.802891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-89ab1ff6-5aa1-4a95-a71a-a5547b07792d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28141 microversion: 2.20 time: 0.078932 Nov 24 18:16:53.803524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 139/277] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:53 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28141 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:53.852184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:53.853487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:53.860648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.861164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.861999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:53.862424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:53.893280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0005f3c5-b4b0-4dd2-913a-e5f6705fd33f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045305 Nov 24 18:16:53.893873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 139/278] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:16:53 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:16:54.043065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-965691358", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "d880d6ba-107a-4ad6-b8bf-f00c7b39332c"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:54.095888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] validate_networks() for [('d880d6ba-107a-4ad6-b8bf-f00c7b39332c', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:16:54.461822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:54.462596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:54.468891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.469022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:16:54.469506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:16:54.469608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.469880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:16:54.470605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:16:54.470786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.471238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:16:54.471340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.480370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.480813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.481622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.482080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.502933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:16:54.508012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for user 5bf4f94ef33c406f86a393463f4f20c2 and project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:16:54.533400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:16:54.534732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:16:54.632098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:54.640604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4f1b4f38-6faf-4b04-8bc9-92730c79bcd0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.182417 Nov 24 18:16:54.641177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 140/279] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:54.646662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:54.647791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:54.654559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.655270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.656283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.656542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7760b9d2-9670-40de-ad34-38b8b74d94a5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617313 Nov 24 18:16:54.657073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.663159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 140/280] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:16:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:16:54.667915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27b69693-fdc1-4f9f-8753-7636feb253a1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:54.668527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27b69693-fdc1-4f9f-8753-7636feb253a1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:54.732876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27b69693-fdc1-4f9f-8753-7636feb253a1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:54.740245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27b69693-fdc1-4f9f-8753-7636feb253a1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1217 microversion: 2.1 time: 0.075986 Nov 24 18:16:54.741007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 141/281] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:54 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:54.776604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3c184909-5378-4243-ac93-2c779cbc2cb9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28278 microversion: 2.1 time: 0.133346 Nov 24 18:16:54.777391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 141/282] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:54 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:54.819153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:54.820125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:54.826511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.826958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.827732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:54.828179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:54.932750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8de4406f-2b22-41b6-9197-82e8a8a84f6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28265 microversion: 2.20 time: 0.121402 Nov 24 18:16:54.936633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 142/283] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:54 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:55.660004 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:55.661316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:55.671313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.671821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.672717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.674171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.757151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:55.758013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:55.765349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.765349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.766077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.766465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.819501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:55.827638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f6ead0ac-f8e8-4f67-9fe7-2c96559b0816 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.172628 Nov 24 18:16:55.828376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 142/284] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:55.834276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:55.839878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:55.841037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:55.842129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b8b6ae93-e8bf-4031-bb58-59873983d300 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1221 microversion: 2.1 time: 0.088845 Nov 24 18:16:55.842806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 143/285] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:55 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:55.847859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.848377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.849393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.849940 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.944788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:55.945703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:55.951900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.952340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.953122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:55.953550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:55.972415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-403e9e92-6538-4b22-a279-bf19f29306ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28535 microversion: 2.1 time: 0.136079 Nov 24 18:16:55.973309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 143/286] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:55 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28535 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:56.047254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-17a8a8e2-8639-4cc9-beee-bef6f498a85c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28431 microversion: 2.20 time: 0.106008 Nov 24 18:16:56.047958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 144/287] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:55 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28431 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:56.844881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:56.846396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:56.853802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:56.854374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:56.856428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:56.856882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:56.863117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:56.863117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:56.870606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:56.871169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:56.872046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:56.872573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:56.966982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:56.988927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ce3cd930-1387-4d3b-9898-724bc15c9962 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1269 microversion: 2.1 time: 0.131196 Nov 24 18:16:57.000315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 145/288] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:56 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:57.023696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:57.023696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:57.025880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:57.026024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:57.026684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:57.027411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:57.027839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:57.036909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-20c8b59c-3d69-42f8-a616-ed980f333871 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.196149 Nov 24 18:16:57.049078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 144/289] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:57.061347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:57.070083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:57.070807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:57.071555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:57.073070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:57.073714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:57.173588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-40c80eee-e9e2-4bdf-a79e-5df272b3c417 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28661 microversion: 2.1 time: 0.170428 Nov 24 18:16:57.174282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 146/290] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:57 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:57.217905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5a90f67a-b9e1-48f2-87c3-9f5cff6e6bc9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28556 microversion: 2.20 time: 0.161481 Nov 24 18:16:57.224515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 145/291] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:57 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:16:58.007135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:58.007838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:58.014874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.015546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.016493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.017126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.055903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:58.056693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:58.071537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.072466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.073362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.073813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.228488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:58.237461 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c2243c01-d463-4485-9922-f277aa0858a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.186290 Nov 24 18:16:58.238115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 146/292] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:16:58.242674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:58.243535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:58.250684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.250920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.253093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.253535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.271280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:58.282678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-00143dfd-0749-474f-8662-864ccfc03b93 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.278467 Nov 24 18:16:58.292607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 147/293] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:58 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:58.298367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:58.299428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:58.305584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.306127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.306889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:58.307331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:58.368110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5994260d-47de-4c30-a12e-bbaec3c51970 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28701 microversion: 2.1 time: 0.128092 Nov 24 18:16:58.368909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 147/294] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:58 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:58.445749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3257ec99-e505-4aa5-a613-de6f68017982 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28599 microversion: 2.20 time: 0.151255 Nov 24 18:16:58.446945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 148/295] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:58 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:16:59.025210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-2d93a8ca-26b0-4b31-978a-c74def4d482f req-6b02c4d3-659f-454a-abf0-e3015b112ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae5c20f-69b8-4965-9dfc-332eb4e2eb7b", "tag": "b50f648a-1dfb-44f2-b30f-48daa153739b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:59.026816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:16:59.026816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:16:59.035434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-2d93a8ca-26b0-4b31-978a-c74def4d482f req-6b02c4d3-659f-454a-abf0-e3015b112ee2 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.037487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-2d93a8ca-26b0-4b31-978a-c74def4d482f req-6b02c4d3-659f-454a-abf0-e3015b112ee2 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.047660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-2d93a8ca-26b0-4b31-978a-c74def4d482f req-6b02c4d3-659f-454a-abf0-e3015b112ee2 service nova] Creating event network-changed:b50f648a-1dfb-44f2-b30f-48daa153739b for instance eae5c20f-69b8-4965-9dfc-332eb4e2eb7b on hv-cinder-80403 Nov 24 18:16:59.052568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-2d93a8ca-26b0-4b31-978a-c74def4d482f req-6b02c4d3-659f-454a-abf0-e3015b112ee2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Nov 24 18:16:59.053154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 148/296] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:16:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:16:59.255965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:59.256663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:59.263660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.264408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.265424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.266071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.300812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:59.301793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:59.308590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.309099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.309914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.310350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.465291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:59.475309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ca612bf-208e-4c51-bc88-fa224e966e24 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.178953 Nov 24 18:16:59.482698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 149/297] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:59 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:59.488142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:59.489450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:59.496473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.497393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.497702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.498322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.568838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:16:59.576861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1edf78a3-16c6-440b-a913-317a1ac5b59f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.325728 Nov 24 18:16:59.577429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 149/298] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:16:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:16:59.582401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:59.583981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:16:59.592033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.592619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6c30074e-de05-46ff-b84f-1c55118caec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28701 microversion: 2.1 time: 0.108407 Nov 24 18:16:59.592852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.597127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 150/299] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:59 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28701 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:59.597300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:16:59.597300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:16:59.677485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f0916e7d-80e9-4922-b21e-ea1a8645fed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28599 microversion: 2.20 time: 0.098601 Nov 24 18:16:59.678172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 150/300] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:16:59 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28599 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:00.498746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:00.499731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:00.507619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.508074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.508909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.509350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.599462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:00.599904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:00.606602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.607341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.608573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.609305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.657093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:00.667177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-63c95a38-6f18-4fe9-a72f-bba7b05fff6f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.177088 Nov 24 18:17:00.667754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 151/301] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:00 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:00.673667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:00.674838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:00.684802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.685265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.686103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.686574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.797075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-43f2519b-92fe-4e64-a058-7050f2a9cfd0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28701 microversion: 2.1 time: 0.127031 Nov 24 18:17:00.798514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 152/302] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:00 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:00.804452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:00.805508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:00.812623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.813071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.814555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:00.814990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:00.822630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:00.832588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f46da6a5-f084-4906-b721-58c56cc529c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.241807 Nov 24 18:17:00.833828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 151/303] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:00.900827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f6747e88-b3cc-4dba-b631-db94c003df5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28599 microversion: 2.20 time: 0.100754 Nov 24 18:17:00.901745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 153/304] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:00 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28599 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:01.686846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:01.687468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:01.698582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.698582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.698582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.698582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.811171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:01.815781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:01.826066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.826594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.827590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.828095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.846440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:01.854723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a44971d-4217-49c0-be23-255cab9c1a8b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.174662 Nov 24 18:17:01.855688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 152/305] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:01 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:01.860742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:01.865329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:01.872688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.874239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.874852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.875295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.914296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-92d1bc71-e37a-4cdb-a6d1-2573dd017501 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28701 microversion: 2.1 time: 0.106803 Nov 24 18:17:01.915895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 154/306] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:01 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28701 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:17:01.922516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:01.923735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:01.930601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.931048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:01.931817 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:01.932244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:02.014800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-23174f6f-5178-4089-affa-e488b2c52adb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28599 microversion: 2.20 time: 0.096738 Nov 24 18:17:02.015907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 155/307] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:01 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28599 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:02.029969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:02.038384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8e6fcc53-02a3-4a48-a217-18f7de0ef69a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.181349 Nov 24 18:17:02.038881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 153/308] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:02.872724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:02.873544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:02.880514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:02.880971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:02.881834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:02.882275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:02.927604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:02.928525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:02.935366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:02.935831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:02.936634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:02.937121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:03.021130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2a391180-48ba-4a64-8be6-bad541f7629e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 28701 microversion: 2.1 time: 0.098174 Nov 24 18:17:03.022247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 154/309] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:02 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 28701 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:17:03.032641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:03.033976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:03.035251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:03.042155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:03.042613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:03.043048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7898c410-8495-4d72-8c1e-7f2773af61bf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.174441 Nov 24 18:17:03.043759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:03.044372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:03.053537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 156/310] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:02 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:03.058415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:03.059286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:03.065578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:03.066137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:03.067680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:03.068368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:03.138105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-870caa87-ac8e-4177-bcbf-0e3a99a7e248 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 28599 microversion: 2.20 time: 0.110017 Nov 24 18:17:03.138670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 155/311] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:03 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 28599 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:03.204748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:03.212304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-13e18c2a-9c4b-4ac2-9d91-ce653a2bc42e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.157354 Nov 24 18:17:03.212862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 157/312] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:04.032874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:04.033840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:04.041078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.041734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.042872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.043836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.061555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:04.062932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:04.071192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.071956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.072974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.073633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.133625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b4f2fa8f-806f-475f-a838-8045ec17d870 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 29223 microversion: 2.1 time: 0.104424 Nov 24 18:17:04.135306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 156/313] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:04 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 29223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:04.150942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:04.152542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:04.160324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.160934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.162014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.162701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.229146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:04.237584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f524c9c4-4c02-4550-a797-7124385443ad tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.180232 Nov 24 18:17:04.238246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 158/314] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:04 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:04.244793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:04.244793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:04.250165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.250616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.252314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:04.252755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:04.270002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8ef7cf18-9b6d-4cbd-9477-4ddf60534371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 29318 microversion: 2.20 time: 0.123143 Nov 24 18:17:04.270924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 157/315] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:04 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 29318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:04.388165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:04.395747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-38bf307b-44c6-4215-920e-5121b55f7a49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.156536 Nov 24 18:17:04.396267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 159/316] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:05.146427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:05.147431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:05.154550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.155002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.155779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.156213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.254006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bc546235-df6d-41af-a5eb-121624d6af7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 30161 microversion: 2.1 time: 0.111917 Nov 24 18:17:05.257947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:05.258453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 158/317] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:05 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 30161 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:05.258556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:05.261635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.262105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.262868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.263291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.283255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:05.284572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:05.292495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.292945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.293912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.294347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.387871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-13cf02f9-2313-4683-841c-7a7432dff6c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 30408 microversion: 2.20 time: 0.108805 Nov 24 18:17:05.389652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 159/318] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:05 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 30408 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:05.401928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:05.410006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a11be6a-0305-4822-82d7-30d186733b9e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.159616 Nov 24 18:17:05.410561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 160/319] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:05 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:05.413179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:05.413899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:05.420760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.421205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.428109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.428109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.569267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:05.590473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-bd7afb14-7c48-451a-bae2-57f68426978c req-36934537-65b9-411e-8818-b2f73e427421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae5c20f-69b8-4965-9dfc-332eb4e2eb7b", "name": "network-vif-plugged", "status": "completed", "tag": "b50f648a-1dfb-44f2-b30f-48daa153739b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:05.590703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-84705a9e-1964-4690-8b6f-dc9830aee00b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.181479 Nov 24 18:17:05.591752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 160/320] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:05.592204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:17:05.592204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:17:05.600763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-bd7afb14-7c48-451a-bae2-57f68426978c req-36934537-65b9-411e-8818-b2f73e427421 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:05.601440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-bd7afb14-7c48-451a-bae2-57f68426978c req-36934537-65b9-411e-8818-b2f73e427421 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:05.612986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-bd7afb14-7c48-451a-bae2-57f68426978c req-36934537-65b9-411e-8818-b2f73e427421 service nova] Creating event network-vif-plugged:b50f648a-1dfb-44f2-b30f-48daa153739b for instance eae5c20f-69b8-4965-9dfc-332eb4e2eb7b on hv-cinder-80403 Nov 24 18:17:05.618220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-bd7afb14-7c48-451a-bae2-57f68426978c req-36934537-65b9-411e-8818-b2f73e427421 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 Nov 24 18:17:05.619143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 161/321] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:17:06.265425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:06.266360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:06.272623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.273068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.273864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.274293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.401220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:06.402277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:06.408691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-667cc3fa-6aeb-4ca9-b090-91c0d141a4d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 31368 microversion: 2.1 time: 0.146647 Nov 24 18:17:06.409544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 161/322] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:06 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 31368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:06.410153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.423991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.423991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.423991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.427674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:06.428366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:06.435109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.435620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.436431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.436861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.530144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ee42443-9e0f-4f04-b7a2-538f38921a6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 31280 microversion: 2.20 time: 0.132622 Nov 24 18:17:06.530857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 162/323] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:06 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 31280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:06.596155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:06.604569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dfdc136f-7a00-4342-8336-b804dbe9d34e tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.182163 Nov 24 18:17:06.605268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 162/324] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:06 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:06.608968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:06.609882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:06.617827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.618303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.619096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:06.619660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:06.762352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:06.770249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b151f6d4-96a4-4ce5-9830-50ab2f62fbeb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.165506 Nov 24 18:17:06.770809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 163/325] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:07.419699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:07.420617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:07.427417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.427869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.428684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.429125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.542809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:07.544952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:07.573599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.574203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.575057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.575492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.697408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a6223d9b-77d4-40f4-9db2-1e8d62aa8331 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 32285 microversion: 2.1 time: 0.281255 Nov 24 18:17:07.698069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 163/326] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:07 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 32285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:07.702748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:07.703425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:07.710171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.710611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.711369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.711795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.720829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-09c686d3-876f-49f5-960f-2f9f8bc56665 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 32152 microversion: 2.20 time: 0.181703 Nov 24 18:17:07.722409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 164/327] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:07 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 32152 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:07.787574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:07.788558 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:07.795489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.795934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.796870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:07.797105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:07.857977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:07.866272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b69e6d48-b6ca-4399-b0de-40c0f032e680 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1317 microversion: 2.1 time: 0.167035 Nov 24 18:17:07.866845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 164/328] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:07 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:07.940945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:07.948353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c9b46196-dd6d-4de3-98d4-0819c2ff64ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.164680 Nov 24 18:17:07.948917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 165/329] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:08.709168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:08.710681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:08.717525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.718167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.719115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.720954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.732770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:08.733616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:08.743010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.743010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.743010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.743010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.839122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-05c6c928-018c-4bf1-954e-33fc8184ab88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 32929 microversion: 2.1 time: 0.133431 Nov 24 18:17:08.842069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 165/330] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:08 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 32929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:08.881270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1657eda8-109f-434b-a8d4-dfb605692380 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 32912 microversion: 2.20 time: 0.152206 Nov 24 18:17:08.882053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 166/331] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:08 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 32912 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:08.884570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:08.885294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:08.893574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.894062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.894889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.895322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.967031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:08.967959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:08.975906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.976448 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:08.977313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:08.977897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:09.038537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:09.046456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-56ab8739-e1ff-4346-a4c0-ed60ae87e855 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1508 microversion: 2.1 time: 0.165972 Nov 24 18:17:09.047059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 166/332] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:08 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:09.253041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:09.260328 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2b693602-abd9-49ba-b2d8-0a16cbd6c2bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.298371 Nov 24 18:17:09.260903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 167/333] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:09.851495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:09.852421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:09.858562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:09.859017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:09.859801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:09.861669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:09.893076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:09.894778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:09.901072 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:09.901610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:09.902768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:09.903247 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:09.965849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-58560e1d-8558-4997-b51d-57b75a5a1f74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 33371 microversion: 2.1 time: 0.117942 Nov 24 18:17:09.966762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 167/334] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:09 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 33371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:10.013197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-09fb88fc-279b-4485-b70d-95ad704cad5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 33285 microversion: 2.20 time: 0.124271 Nov 24 18:17:10.018287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 168/335] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:09 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 33285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:10.277696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:10.278440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:10.286362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.289933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:10.289933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.289933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:10.427357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:10.434728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ec3caef1-ad06-4369-b99d-1967cacbc00e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.160954 Nov 24 18:17:10.435298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 168/336] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:10.732987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59433ea-bf37-4955-b761-2b0802a947a9"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:10.734157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:10.741737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.742395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:10.743176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.743614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:10.977585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:10.978427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:10.986982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.987433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:10.988206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:10.988641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:11.074841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab0109c7-e98e-4199-958d-4b9df1d097f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 33655 microversion: 2.1 time: 0.100830 Nov 24 18:17:11.075484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 169/337] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:10 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 33655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:17:11.083839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:11.084936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:11.094731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:11.095532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:11.096461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:11.097053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:11.195673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-88a79888-57c8-4fff-ad0e-e83fa12cfcff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 33640 microversion: 2.20 time: 0.118467 Nov 24 18:17:11.196666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 170/338] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:11 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 33640 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:11.452302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a773c0f2-15f3-484a-99a7-385774e0141b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722928 Nov 24 18:17:11.452801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:11.453203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 169/339] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:10 2021] POST /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:11.454124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:11.468736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:11.469363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:11.470379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:11.470827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:11.616875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:11.624788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d95d05a-04d5-41fd-bfc0-d7fcb5016ada tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.175934 Nov 24 18:17:11.625614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 171/340] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:12.088160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:12.089250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:12.097008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.097519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.098338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.098825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.208011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:12.208961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:12.209664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c651219e-877a-411b-953f-89634e71821d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 34038 microversion: 2.1 time: 0.125785 Nov 24 18:17:12.211004 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 170/341] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:12 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 34038 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:12.215255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.215705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.216491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.216928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.331168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95a155ff-a8fa-4dab-926d-146f0f63c94a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 34121 microversion: 2.20 time: 0.127149 Nov 24 18:17:12.332115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 172/342] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:12 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 34121 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:12.643009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:12.643612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:12.650570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.655483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.655483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:12.655483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:12.789180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:12.796397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b6c45f5e-959a-4ed2-9462-9b52af8a0464 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.157538 Nov 24 18:17:12.796952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 171/343] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:13.223135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:13.224132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:13.230864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.231311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.232085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.232517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.324540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-05eb5fed-f3c3-49d8-b739-e4a9bd2d51f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 34615 microversion: 2.1 time: 0.106404 Nov 24 18:17:13.325177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 173/344] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:13 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 34615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:13.344027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:13.346003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:13.354343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.354823 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.355762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.356196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.455143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-007ae88f-0150-478c-a430-0145bd7eb38b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 34813 microversion: 2.20 time: 0.115069 Nov 24 18:17:13.455789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 172/345] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:13 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 34813 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:13.814257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:13.814990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:13.821839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.822293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.823090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:13.823527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:13.956164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:13.964568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d8d1b170-d466-405f-baf7-33ac6eb6dc54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.154477 Nov 24 18:17:13.965300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 174/346] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:14.336899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:14.343245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:14.345012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.345466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:14.346272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.346711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:14.435359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6a0bc83a-0522-468d-8365-5c10229860ad tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 35241 microversion: 2.1 time: 0.102306 Nov 24 18:17:14.436276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 173/347] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:14 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 35241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:14.466292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:14.467400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:14.473950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.474396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:14.475174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.475608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:14.567720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a001fba5-7e64-4538-abe8-552e087e4e5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 35402 microversion: 2.20 time: 0.105122 Nov 24 18:17:14.568375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 175/348] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:14 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 35402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:14.982616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:14.983300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:14.990789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.991237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:14.992007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:14.992439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:15.131850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:15.139007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-531aa5c6-348f-44f2-a3fe-b79f0d60a4b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.160364 Nov 24 18:17:15.139558 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 174/349] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:15.448556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:15.449553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:15.456971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:15.457421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:15.458233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:15.458669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:15.566022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ce1ac847-f931-462b-8347-8cb920f8e7d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 35879 microversion: 2.1 time: 0.121500 Nov 24 18:17:15.567778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 176/350] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:15 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 35879 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:15.578830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:15.580475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:15.586749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:15.587202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:15.587977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:15.588414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:15.700785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c9b8fb14-6560-4ccb-ab35-9fd5f81dbaf0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 36136 microversion: 2.20 time: 0.125389 Nov 24 18:17:15.701689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 175/351] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:15 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 36136 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:16.156536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:16.157245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:16.165110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.165556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:16.166358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.166792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:16.298608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:16.306400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3193904d-10bf-4098-b93a-9cec05567b03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.153872 Nov 24 18:17:16.306955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 177/352] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:16.578786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:16.580925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:16.587827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.588277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:16.589048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.589482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:16.713575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:16.714508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:16.721938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.722382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:16.723153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:16.723583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:19.523902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9740db44-e8da-4c57-baa7-5100c959ba0e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 38178 microversion: 2.1 time: 2.948912 Nov 24 18:17:19.524573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 176/353] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:16 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 38178 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:19.529512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:19.530220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:19.537615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:19.538089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:19.538850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:19.539277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:19.570013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-35d3e0b2-e28e-4148-b75e-80723c714189 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 38013 microversion: 2.20 time: 2.859866 Nov 24 18:17:19.571789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 178/354] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:16 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 38013 bytes in 2861 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:19.669655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:19.677529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8cd4b1bd-be23-496b-a8bc-02019e49753c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.151698 Nov 24 18:17:19.678127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 177/355] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:20.536450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:20.537487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:20.544410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.544856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.545623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.546081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.581586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:20.582592 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:20.588989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.589474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.590294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.590731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.652571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b5b775fe-e546-4dcd-8e92-fb4472195c68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 38178 microversion: 2.1 time: 0.120268 Nov 24 18:17:20.653226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 179/356] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:20 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 38178 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:20.674023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8b5c013a-7060-4bb1-ba01-c16c3b1ceec0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 38013 microversion: 2.20 time: 0.096009 Nov 24 18:17:20.678494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 178/357] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:20 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 38013 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:20.694884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:20.695657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:20.702758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.703282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.705299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:20.705850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:20.904645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:20.911972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d03e6bef-bd7e-4cf5-8c14-249e57c73fc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.221211 Nov 24 18:17:20.912534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 180/358] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:21.664623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:21.665665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:21.672932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.674513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.675631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.676086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.687303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:21.688980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:21.695607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.696288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.697087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.697515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.787591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9c27b11d-429e-4de2-b399-3d12bb2448b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 38309 microversion: 2.1 time: 0.126813 Nov 24 18:17:21.788238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 179/359] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:21 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 38309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:21.798930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:21.799583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:21.804509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1a494385-0379-430c-8e57-d150edcce934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 200 len: 38153 microversion: 2.20 time: 0.121793 Nov 24 18:17:21.810036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 181/360] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:21 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 38153 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:17:21.810229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.810229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.810229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.810229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.815992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:21.816570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:21.823467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.823911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.824685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.825117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.833426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-200baef5-43ab-4036-bc79-e3e83437b26c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/ips" status: 200 len: 146 microversion: 2.1 time: 0.038799 Nov 24 18:17:21.834035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 180/361] 10.222.0.53 () {58 vars in 1247 bytes} [Wed Nov 24 18:17:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:17:21.849601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4cd89fad-d2f4-459a-846e-8f3e60862861 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/ips" status: 200 len: 150 microversion: 2.20 time: 0.038026 Nov 24 18:17:21.850345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 182/362] 10.222.0.53 () {60 vars in 1288 bytes} [Wed Nov 24 18:17:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:17:21.928918 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:21.929695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:21.936738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.937193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:21.938141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:21.938775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.090976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59433ea-bf37-4955-b761-2b0802a947a9"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:22.092425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:22.099669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:22.102688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.103151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.103934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.104368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.107140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d137e800-389c-4070-b72f-bb665a0151a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1522 microversion: 2.1 time: 0.182516 Nov 24 18:17:22.117071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 181/363] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:22.181466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Invalid volume: volume e59433ea-bf37-4955-b761-2b0802a947a9 is already attached to instances: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b Nov 24 18:17:22.182157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 400 to user: Invalid volume: volume e59433ea-bf37-4955-b761-2b0802a947a9 is already attached to instances: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:17:22.182986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a1417bfc-1e8d-4fb0-a9c0-ca423595028d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096147 Nov 24 18:17:22.183528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 183/364] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:22 2021] POST /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 18:17:22.242110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:22.242621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:22.248989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.249434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.250230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.250658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.345750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.objects.instance [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lazy-loading 'services' on Instance uuid eae5c20f-69b8-4965-9dfc-332eb4e2eb7b {{(pid=116731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:17:22.562821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9e4e1587-9000-4e50-bc78-7cb3d57b1d94 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments/e59433ea-bf37-4955-b761-2b0802a947a9" status: 202 len: 0 microversion: 2.1 time: 0.325906 Nov 24 18:17:22.564002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 182/365] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:17:22 2021] DELETE /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments/e59433ea-bf37-4955-b761-2b0802a947a9 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:22.573863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:22.577338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:22.587568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.588019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.588878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:22.589353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:22.640758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5773919d-3aac-474e-a749-e9fbf20d913f tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071750 Nov 24 18:17:22.641324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 184/366] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:17:22 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:23.125168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:23.126587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:23.132353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.132793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.133556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.134015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.262343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:23.269798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-00f83407-d9d9-4546-be68-a4237ce69d30 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1502 microversion: 2.1 time: 0.149089 Nov 24 18:17:23.270357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 183/367] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:23.289301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44519d45-db7f-48ad-a6d6-6d121ad4fae5"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:23.289301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:23.293860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.294326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.295134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.295569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.327763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] HTTP exception thrown: Cannot 'attach_volume' instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f while it is in vm_state rescued Nov 24 18:17:23.327763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Returning 409 to user: Cannot 'attach_volume' instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f while it is in vm_state rescued {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:17:23.327763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8952597d-d5c0-44dd-a07b-7d3a29eda46a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040390 Nov 24 18:17:23.327763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 185/368] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:23 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 18:17:23.331813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:23.332348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:23.338333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.338779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.339555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.339993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.576306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5e743d95-ef1c-40e8-a826-8bc710960d4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action" status: 202 len: 0 microversion: 2.1 time: 0.248616 Nov 24 18:17:23.577293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 184/369] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:23 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:23.602524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:23.606481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:23.614742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.615196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.615987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.616422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.652936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:23.654444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:23.662005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.662824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.663686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:23.664128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:23.699829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e43b4a12-90e0-42dd-895b-a0b760f6780d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050872 Nov 24 18:17:23.700983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 185/370] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:17:23 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:23.793365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:23.803262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-086fa12c-5012-4b24-8c52-cd40a0527cc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1510 microversion: 2.1 time: 0.205237 Nov 24 18:17:23.804266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 186/371] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:24.711774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:24.712778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:24.720409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:24.720859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:24.721675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:24.722141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:24.755795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7d0a9ed-2c35-4ad4-848b-760ad7ae42e4 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047791 Nov 24 18:17:24.756369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 186/372] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:17:24 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:17:24.820805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:24.821461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:24.827972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:24.828417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:24.829882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:24.830320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:24.902930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-132226089", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "d880d6ba-107a-4ad6-b8bf-f00c7b39332c"}]}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:24.961170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.network.neutron [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] validate_networks() for [('d880d6ba-107a-4ad6-b8bf-f00c7b39332c', None, None, None, None, None)] {{(pid=116731) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:17:24.971320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:24.978714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f3fc5e5-8cd1-4b21-b454-32b744e20d16 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1510 microversion: 2.1 time: 0.161725 Nov 24 18:17:24.979320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 187/373] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:25.231416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43060ca2-8552-4509-982d-aa32e1c9db3b"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:25.232743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:25.239694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.240138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.241115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.241558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.356068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:17:25.356496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image limits 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:17:25.356964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Flavor pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:17:25.357596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Image pref 0:0:0 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:17:25.358086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.virt.hardware [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:17:25.368108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.368589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.369449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.370035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.393102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:17:25.397261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Getting quotas for user 5bf4f94ef33c406f86a393463f4f20c2 and project 1725839d8ee14641976a34987403c3af. Resources: {'instances', 'ram', 'cores'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:17:25.424067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Going to run 1 instances... {{(pid=116731) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:17:25.427141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:17:25.542438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4b9709be-814f-4724-a6e8-824f63d81de3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643049 Nov 24 18:17:25.543339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 187/374] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:17:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:17:25.555859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8caca4f0-f74c-478a-aff6-31c3ec28628d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:25.556426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8caca4f0-f74c-478a-aff6-31c3ec28628d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:25.612796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8caca4f0-f74c-478a-aff6-31c3ec28628d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:25.621188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8caca4f0-f74c-478a-aff6-31c3ec28628d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1217 microversion: 2.1 time: 0.070899 Nov 24 18:17:25.622121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 188/375] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:25 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:25.668638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:25.669192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:25.676490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.676941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.677801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:25.678196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:25.703626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.objects.instance [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lazy-loading 'flavor' on Instance uuid 837cce81-17da-4d50-ae72-0fa0765ffb36 {{(pid=116731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:17:26.057274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c529157d-7b88-4218-9f38-b14d305847ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829371 Nov 24 18:17:26.057948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 188/376] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:25 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:17:26.068271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:26.068968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:26.075757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.076287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.077137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.077725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.245341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:26.253804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-db2a2ec1-71ed-4312-a7f5-7616124ee757 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1510 microversion: 2.1 time: 0.190138 Nov 24 18:17:26.254604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 189/377] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:26.389501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4968f885-9fb5-4fc4-84ce-178082ee989d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 202 len: 0 microversion: 2.20 time: 0.725321 Nov 24 18:17:26.390179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 189/378] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:17:25 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:17:26.402861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:26.403409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:26.412062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.412566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.413298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.413742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.565710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:26.573714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:26.575263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:26.576432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3d910d16-a85a-447b-9838-ab6ec9518109 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.180938 Nov 24 18:17:26.576973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 190/379] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:26.638110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:26.638799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:26.645542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.646016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.646785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:26.647219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:26.706183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:26.713664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-454e0094-8452-48aa-88e3-0a21d04d16df tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1221 microversion: 2.1 time: 0.079586 Nov 24 18:17:26.714301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 190/380] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:26 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:27.271114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:27.271731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:27.277516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.278019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.278916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.279363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.414540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:27.422116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-65f36580-aa0c-423e-9e28-b69d2ca5d662 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1510 microversion: 2.1 time: 0.155370 Nov 24 18:17:27.423231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 191/381] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:27.533395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7af0bfd-8337-4967-bb8f-7b03ba5678fb", "device": "/dev/sdb"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:27.534982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:27.541512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.541992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.542781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.543216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.596140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:27.596757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:27.607511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.607970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.608763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.609203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.776925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:27.784984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:27.787744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:27.787744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d4aa1901-ba64-4608-9e15-7d2c11433340 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.195222 Nov 24 18:17:27.788206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 192/382] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:27.792371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:27.792971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:27.798750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.799192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.799958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:27.800654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:27.862578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:27.871427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e076e50b-f21a-42e1-ada2-9dd949de547b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1269 microversion: 2.1 time: 0.082185 Nov 24 18:17:27.872329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 193/383] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:27 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:28.344043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e3c18b27-3e21-4221-8b99-e0aa7a1892a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "POST /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815293 Nov 24 18:17:28.347113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 191/384] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:27 2021] POST /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:28.440812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:28.442143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:28.448076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.448528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.451634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.452145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.684568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:28.694142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1cec581b-6e5d-4ffd-b219-d81e86259400 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1516 microversion: 2.1 time: 0.257458 Nov 24 18:17:28.694732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 194/385] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:28.807090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:28.807781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:28.816417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.817097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.818052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.818638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.889094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:28.890906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:28.898296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.899033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.914414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:28.915163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:28.967606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:28.976829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:28.978379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:28.979565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cdb93891-1e44-446c-af35-43bff1477c16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.176491 Nov 24 18:17:28.980111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 192/386] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:29.177829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:29.187485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-85ef861a-8288-43fe-a347-d8455e0bfe52 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.302784 Nov 24 18:17:29.188955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 195/387] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:28 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:30.001315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:30.001315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:30.008164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.009114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.010212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.010814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.012983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-021987ee-1541-4f54-a4da-fec4c96c3ecf req-becb8ab8-9d1e-4f47-887d-2e731709bdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61485fb2-fb34-4a48-81e1-18bf5b54539c", "tag": "b172d6a5-f94e-47a6-83d2-1659c569b824"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:30.014940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:17:30.014940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:17:30.025044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-021987ee-1541-4f54-a4da-fec4c96c3ecf req-becb8ab8-9d1e-4f47-887d-2e731709bdbd service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.025812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-021987ee-1541-4f54-a4da-fec4c96c3ecf req-becb8ab8-9d1e-4f47-887d-2e731709bdbd service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.040402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-021987ee-1541-4f54-a4da-fec4c96c3ecf req-becb8ab8-9d1e-4f47-887d-2e731709bdbd service nova] Creating event network-changed:b172d6a5-f94e-47a6-83d2-1659c569b824 for instance 61485fb2-fb34-4a48-81e1-18bf5b54539c on hv-cinder-80403 Nov 24 18:17:30.046912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-021987ee-1541-4f54-a4da-fec4c96c3ecf req-becb8ab8-9d1e-4f47-887d-2e731709bdbd service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038266 Nov 24 18:17:30.048683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 196/388] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:17:30.163419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:30.171587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:30.173702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:30.175069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cd8f09a1-9ba7-4358-b948-ff92d3bf6a12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.180243 Nov 24 18:17:30.179634 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 193/389] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:30.206861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:30.207834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:30.214245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.214684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.215564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.216304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.319927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:30.320624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:30.326990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.328366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.328482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.329391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.447252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:30.455847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d61e0e33-86f7-4d61-b113-2013f9f8cbcf tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.254037 Nov 24 18:17:30.456507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 197/390] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:30 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:30.483398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:30.491906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0498ac9e-9a26-47ce-98b5-1e57f03f00cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1516 microversion: 2.1 time: 0.176187 Nov 24 18:17:30.492668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 194/391] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:30.510504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99768356-a6b3-4749-9dfa-f3e4c550a05b"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:30.511629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:30.518535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.518991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:30.519817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:30.520238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:31.194601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:31.195227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:31.201525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:31.202000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:31.202773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:31.203218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:31.340786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:31.348797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:31.350444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:31.351597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df54ba11-35d5-49be-96eb-c2c8f03c2f1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.160806 Nov 24 18:17:31.352150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 195/392] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:31.384497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d3c417c-90b3-4608-bc5b-6194649a4634 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877937 Nov 24 18:17:31.393332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 198/393] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:30 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:31.472958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:31.473731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:31.479597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:31.480045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:31.480825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:31.481263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:31.632459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:31.639929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-22b1e3be-ee01-4ee4-a66f-919ccdb98c4d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.171427 Nov 24 18:17:31.640491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 196/394] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:31 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:32.371297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:32.371987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:32.378618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:32.379048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:32.379809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:32.380240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:32.523861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:32.532970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:32.534498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:32.535683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a8c5739b-e94d-4282-8bc3-f6756d015aac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.168916 Nov 24 18:17:32.536557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 199/395] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:32 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:32.658073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:32.658687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:32.665062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:32.665514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:32.666341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:32.666763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:32.796849 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:32.804636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dd868ca6-3ad6-4214-83b2-6d8e292568bc tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.150868 Nov 24 18:17:32.805300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 197/396] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:32 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:33.554904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:33.555501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:33.563227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:33.564937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:33.568431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:33.568431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:33.714215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:33.722984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:33.724572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:33.725807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d6797f16-8d46-4942-aca1-6bd750ecea17 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.174690 Nov 24 18:17:33.726371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 200/397] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:33.822206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:33.822826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:33.829259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:33.829738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:33.830548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:33.830982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:33.962376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:33.970110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a8e9be35-1e85-47df-97e1-4696ad97a24d tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.150972 Nov 24 18:17:33.970749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 198/398] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:33 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:34.744253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:34.744944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:34.751139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:34.751582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:34.752354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:34.752787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:34.882092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:34.889725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:34.891873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:34.893000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e58afc3d-90c5-4155-a583-1c3f80758f31 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.152420 Nov 24 18:17:34.893553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 201/399] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:34.986568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:34.987173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:34.993332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:34.993842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:34.994605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:34.995033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:35.124667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:35.132523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cfb30845-7a02-4248-b78c-9674edaf84c3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.149573 Nov 24 18:17:35.133103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 199/400] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:34 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:35.911341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:35.911959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:35.918521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:35.918773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:35.919532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:35.919934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:36.150425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:36.151033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:36.157691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:36.158180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:36.158970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:36.159407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:36.258140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:36.265987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:36.267649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:36.268809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e7e2acd2-11be-41e0-907a-cda92aa6b27c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.361167 Nov 24 18:17:36.269399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 202/401] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:36.290671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:36.298387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-03f793d6-4779-4d7b-8eca-2a0c65ad0078 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.151022 Nov 24 18:17:36.298975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 200/402] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:36 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:36.826549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-199b68dd-5384-465d-98c7-499eea03ef17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:36.833393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-199b68dd-5384-465d-98c7-499eea03ef17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:36.833873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-199b68dd-5384-465d-98c7-499eea03ef17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:36.917423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-199b68dd-5384-465d-98c7-499eea03ef17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Going to try to stop instance {{(pid=116730) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 18:17:37.158967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-199b68dd-5384-465d-98c7-499eea03ef17 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.335630 Nov 24 18:17:37.164492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 203/403] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:36 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:37.178196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:37.179564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:37.194606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.194606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.194606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.194606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.291192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:37.291870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:37.298421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.298858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.299815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.300513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.394009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:37.401083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b63304f3-85be-417d-b8fd-56e3755e10eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.235934 Nov 24 18:17:37.401667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 201/404] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:37.405986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:37.407439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:37.415416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.415632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.417353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:37.417353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:37.452211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:37.462496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:37.464027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:37.465694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff7d1587-5089-402e-9e6c-b369d454a8a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.179694 Nov 24 18:17:37.466302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 204/405] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:37.575188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:37.583096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-053d2598-60c2-48c3-a9ea-97209411ae48 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.180449 Nov 24 18:17:37.583654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 202/406] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:37 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:38.420028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:38.420635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:38.427108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.427558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.428325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.428758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.484525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:38.485512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:38.492000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.492696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.498851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.498851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.574335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:38.582861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b7db8880-88f4-421f-9556-73016e2a6fa9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.166492 Nov 24 18:17:38.584465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 205/407] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:38.607771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:38.609036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:38.615164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.615614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.616396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:38.616832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:38.757057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:38.764933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef6953f6-c74a-4b2f-a703-eabe937ef61a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.168059 Nov 24 18:17:38.765509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 206/408] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:38 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:38.865343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:38.873148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:38.874678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:38.876473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-03fb7084-cca3-4b2e-ba74-2e4a744ef678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.395747 Nov 24 18:17:38.877031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 203/409] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:39.599899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:39.600507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:39.606626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.607075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.607839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.608275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.741419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:39.749191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe23737a-6da8-47d9-a910-5902a8ab431e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.152849 Nov 24 18:17:39.749753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 207/410] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:39.782808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:39.783423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:39.789795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.790263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.792208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.792208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.895052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:39.895767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:39.902139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.902679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.903557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:39.904062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:39.924043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:39.931650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b69162ac-1d45-4c4d-a56a-72ea5d6f3afb tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.153169 Nov 24 18:17:39.932218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 204/411] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:39 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:40.037642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:40.045260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:40.046784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:40.048408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f10ce060-27a7-4ef3-962f-33aeb93038d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.157635 Nov 24 18:17:40.048970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 208/412] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:39 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:40.766772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:40.767302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:40.773126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:40.773569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:40.774363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:40.774792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:40.905108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:40.913754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f1f47f75-f8fc-4d10-a85b-f09c45a388a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.150795 Nov 24 18:17:40.914348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 205/413] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:40.948289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:40.948888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:40.956036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:40.956472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:40.957226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:40.957655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:41.068100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:41.069223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:41.075124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:41.075426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:41.076207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:41.077313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:41.090916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:41.098383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4b8d382b-0f43-4a90-8c27-b17f9c6c90d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.153668 Nov 24 18:17:41.099058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 209/414] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:40 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:41.209055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:41.216608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:41.218135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:41.219898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3ca73717-06fe-4879-b51f-07e4020e0454 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.154887 Nov 24 18:17:41.220462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 206/415] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:41.931349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:41.931954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:41.937693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:41.938336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:41.939331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:41.939752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.072400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:42.080350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4937d5bb-acb9-4737-a9c3-31b8d2026b65 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.152616 Nov 24 18:17:42.080909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 210/416] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:42.115502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:42.116115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:42.122396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:42.122848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.123631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:42.124069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.238117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:42.238721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:42.244320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:42.244757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.245545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:42.246004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.251320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:42.258498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bb1de753-6fa8-46ec-bff5-1d4d19ed628a tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.146622 Nov 24 18:17:42.259061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 207/417] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:42 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:42.374544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:42.382263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:42.383761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:42.384892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27fe7471-48f5-4293-a804-47f6e590a0a4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.150694 Nov 24 18:17:42.385451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 211/418] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:42.788366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-0dccdd0d-e229-4104-a3e6-211c7b74dde9 req-f75ef67b-41d2-42e0-aacc-a11baf4c1489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61485fb2-fb34-4a48-81e1-18bf5b54539c", "name": "network-vif-plugged", "status": "completed", "tag": "b172d6a5-f94e-47a6-83d2-1659c569b824"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:42.794214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:17:42.794214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:17:42.797271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-0dccdd0d-e229-4104-a3e6-211c7b74dde9 req-f75ef67b-41d2-42e0-aacc-a11baf4c1489 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:42.797839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-0dccdd0d-e229-4104-a3e6-211c7b74dde9 req-f75ef67b-41d2-42e0-aacc-a11baf4c1489 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:42.809454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-0dccdd0d-e229-4104-a3e6-211c7b74dde9 req-f75ef67b-41d2-42e0-aacc-a11baf4c1489 service nova] Creating event network-vif-plugged:b172d6a5-f94e-47a6-83d2-1659c569b824 for instance 61485fb2-fb34-4a48-81e1-18bf5b54539c on hv-cinder-80403 Nov 24 18:17:42.815150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-0dccdd0d-e229-4104-a3e6-211c7b74dde9 req-f75ef67b-41d2-42e0-aacc-a11baf4c1489 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030290 Nov 24 18:17:42.816010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 208/419] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:43.097446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:43.098124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:43.104319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.104770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.105555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.106014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.277863 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:43.279049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:43.286422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.286865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.287647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.288136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.310519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:43.319338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ac3e2816-4941-4dd0-9de8-24d67ecd665f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.225585 Nov 24 18:17:43.326100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 212/420] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:43.403858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:43.404564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:43.410690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.411141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.411924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:43.412363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:43.437287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:43.445777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e68f73c3-08db-4f07-af61-b059d9e54583 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.172632 Nov 24 18:17:43.446641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 209/421] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:43 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:43.556178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:43.567300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:43.568814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:43.569998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6725ae2a-ff4b-4dcd-812b-ff9eabcfabad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.169789 Nov 24 18:17:43.570564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 213/422] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:44.336570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:44.337145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:44.343269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.343725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.344556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.345574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.463260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:44.463872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:44.470224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.470772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.471554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.471994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.484317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:44.492882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a3df796f-9e61-474f-b673-17a59a72b56a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.160189 Nov 24 18:17:44.493457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 210/423] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:44.588348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:44.588873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:44.594610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.595181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.595969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:44.596400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:44.605969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:44.613708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d431b5de-a7cb-422a-b6c7-2ba925570904 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.154086 Nov 24 18:17:44.614299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 214/424] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:44 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:44.731851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:44.739625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:44.741155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:44.742329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ff9c25ad-d64f-4899-9770-a84b280b20bf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.157859 Nov 24 18:17:44.742891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 211/425] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:45.510605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:45.511218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:45.517425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.517914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.518691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.519132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.630573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:45.631184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:45.637355 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.637740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.638538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.638965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.650328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:45.658832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a63ec880-9112-4750-96f5-f9043024fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.151712 Nov 24 18:17:45.659472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 215/426] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:45.760708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:45.761321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:45.767602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:45.767756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.768234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.769329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:45.769671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:45.774764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-46f3572b-ba34-43e0-836b-7348ae6ff0c8 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1317 microversion: 2.1 time: 0.147859 Nov 24 18:17:45.775351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 212/427] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:45 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:45.902790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:45.911557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:45.913070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:45.914247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a44e0673-5143-42f8-95a1-74bb785c4847 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.157380 Nov 24 18:17:45.914805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 216/428] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:46.676473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:46.677081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:46.683385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.683836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.684665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.685050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.792133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:46.792749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:46.799622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.800331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.801098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.801531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.816377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:46.824126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8e251615-4cf0-4fc4-80d1-894fad857ee4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.152138 Nov 24 18:17:46.827833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 213/429] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:46.932173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:46.932889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:46.935585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:46.939388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.939831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.940606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:46.941029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:46.943744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-624ac480-f8d7-4213-a5af-71c4cfd628d7 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1507 microversion: 2.1 time: 0.155243 Nov 24 18:17:46.944402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 217/430] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:46 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:17:47.075481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:47.084051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:47.085549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:47.086732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d72c5882-d6a3-4619-8b3c-36c51e1e6d92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1722 microversion: 2.20 time: 0.158252 Nov 24 18:17:47.087289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 214/431] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:46 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:47.841755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:47.842384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:47.848667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:47.849121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:47.849961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:47.850411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:47.977556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:47.985296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42a2faf3-0eff-4b53-90c6-8f0f1d697bdd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.147247 Nov 24 18:17:47.986038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 218/432] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:48.104883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:48.105432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:48.112555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:48.113001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:48.113783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:48.114234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:48.240418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:48.247932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:48.249410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:48.250596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0c1907c1-cbfa-42f2-971d-7d2fbe238efa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1743 microversion: 2.20 time: 0.149466 Nov 24 18:17:48.251214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 215/433] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:49.001679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:49.002305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:49.008598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:49.009055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:49.009873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:49.010315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:49.142728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:49.150571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-76d65073-ca03-47e3-af35-8fd707986a44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.152844 Nov 24 18:17:49.151140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 219/434] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:49.269510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:49.270072 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:49.276296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:49.276741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:49.277511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:49.277975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:49.408407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:49.416123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:49.417628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:49.418813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bd7ef25b-7b27-467a-a035-a42005bf3736 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1743 microversion: 2.20 time: 0.154251 Nov 24 18:17:49.419374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 216/435] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:50.167917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:50.168527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:50.175695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:50.176142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:50.176923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:50.177364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:50.303354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:50.310968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-69cc1aed-b8b3-42af-a0d1-4ffb1253fd5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.146752 Nov 24 18:17:50.311537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 220/436] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:50.437398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:50.437939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:50.444625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:50.445071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:50.445870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:50.446303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:50.583879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:50.591883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:50.593386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:50.594573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d18c83da-7b5d-441e-b6df-7a068ce962ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1743 microversion: 2.20 time: 0.160974 Nov 24 18:17:50.595776 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 217/437] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:50.804594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-5b790aa2-81e6-430b-947a-bab1ca9ef0a2 req-b7c8f6b7-763e-45e8-825a-d96855f40b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "name": "network-vif-plugged", "status": "completed", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:50.806223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:17:50.806223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:17:50.813271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5b790aa2-81e6-430b-947a-bab1ca9ef0a2 req-b7c8f6b7-763e-45e8-825a-d96855f40b72 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:50.814453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5b790aa2-81e6-430b-947a-bab1ca9ef0a2 req-b7c8f6b7-763e-45e8-825a-d96855f40b72 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:50.828633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-5b790aa2-81e6-430b-947a-bab1ca9ef0a2 req-b7c8f6b7-763e-45e8-825a-d96855f40b72 service nova] Creating event network-vif-plugged:644fba12-d45b-488a-b7aa-07835df6583b for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 on hv-cinder-80403 Nov 24 18:17:50.831158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-5b790aa2-81e6-430b-947a-bab1ca9ef0a2 req-b7c8f6b7-763e-45e8-825a-d96855f40b72 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Nov 24 18:17:50.831744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 221/438] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:17:51.327812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:51.328416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:51.334892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:51.335329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:51.336093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:51.336522 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:51.466614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:51.474871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8db2088d-11a6-4da6-995d-f269a0f2c35a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.150635 Nov 24 18:17:51.475471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 218/439] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:51.730007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:51.730007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:51.730007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:51.730007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:51.732493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:51.732493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:51.766816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:51.776857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:51.776857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:51.777266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-85fe329a-4c32-4e4e-bdb3-dfadad19bc6b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.167547 Nov 24 18:17:51.777867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 222/440] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:52.492450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:52.493047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:52.499730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:52.500407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:52.502196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:52.502779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:52.673423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:52.683285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6acccc82-899a-4389-9952-5eec935dc1bc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.194462 Nov 24 18:17:52.687630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 219/441] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:52.797401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:52.798167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:52.816232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:52.816743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:52.817603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:52.818074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:53.042652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:53.052470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:53.053932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:53.057715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-38cb7da4-9574-43f4-accb-8beed47c676a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.261999 Nov 24 18:17:53.058313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 223/442] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:53.704717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:53.706279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:53.713092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:53.713544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:53.714537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:53.714976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:53.876485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:53.884760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-16274822-f565-4c27-8801-f0a79273c0e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.184206 Nov 24 18:17:53.896468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 220/443] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:54.084917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:54.086192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:54.093220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:54.093691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:54.094518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:54.095027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:54.238094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:54.246402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:54.248049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:54.249320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8f93cbeb-dbdd-472b-8812-9d4b02282e8f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.168293 Nov 24 18:17:54.250062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 224/444] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:54.957111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:54.957111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:54.957111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:54.957111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:54.958409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:54.958409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:55.094110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:55.102051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-65f456ad-67b9-4313-b7e1-199b6542ea8d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.203194 Nov 24 18:17:55.105347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 221/445] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:55.270172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:55.270752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:55.277006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:55.277478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:55.278274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:55.278705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:55.411380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:55.419161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:55.420673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:55.421861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-53f3ceda-239f-42ee-ae66-d68673b8f125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.157148 Nov 24 18:17:55.422416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 225/446] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:56.123676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:56.124403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:56.131759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:56.132215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:56.132999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:56.133432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:56.293365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:56.302517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b29109ac-a25d-426f-a265-3c3c1d425473 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.186826 Nov 24 18:17:56.303556 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 222/447] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:56.440282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:56.441633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:56.447920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:56.448544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:56.451846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:56.452288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:56.617674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:56.625725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:56.628547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:56.629722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-889f7a41-5ca3-4211-a597-a786fec81934 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.193243 Nov 24 18:17:56.630327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 226/448] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:17:57.109302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afb4a8c8-0be7-407a-bad5-df132d91a4c9"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:57.111479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:57.118599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.119048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.119824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.120267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.322695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:57.328085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:57.330711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.331424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.332339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.332874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.508200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:57.519080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-00a4c100-5c1c-4f81-89fe-728d4f6fad6b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1723 microversion: 2.1 time: 0.200329 Nov 24 18:17:57.520179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 227/449] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:57.678497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:57.678497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:57.678497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.678497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.678844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:57.678844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:57.819698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:57.833827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:57.833827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:57.833827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-981a000c-0cb8-4a23-97f0-535cbfc3f61f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.182330 Nov 24 18:17:57.834191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 228/450] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:58.320922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-246078b4-e656-4f20-8481-7dc9e47b08ec tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "POST /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215069 Nov 24 18:17:58.322260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 223/451] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:17:57 2021] POST /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:58.537279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:58.538400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:58.545325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:58.545808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:58.546609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:58.547055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:58.694785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:58.702742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a0786b9-0fac-48c5-9d5b-9fdcd830e340 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1700 microversion: 2.1 time: 0.169496 Nov 24 18:17:58.703325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 229/452] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1700 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:58.747319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0d8fc10e-63bb-4a05-8af9-d3145bf13d69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:58.753682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d8fc10e-63bb-4a05-8af9-d3145bf13d69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:58.754156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d8fc10e-63bb-4a05-8af9-d3145bf13d69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:58.813161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0d8fc10e-63bb-4a05-8af9-d3145bf13d69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Going to try to start instance {{(pid=116731) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 18:17:58.862113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:58.862720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:58.874619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:58.875074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:58.875998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:58.876651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:59.032229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:59.040239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:59.052400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:59.052400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-58bdbe1c-c322-4830-9757-ceb9f1611fc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.184631 Nov 24 18:17:59.052400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 230/453] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:17:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:17:59.212286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0d8fc10e-63bb-4a05-8af9-d3145bf13d69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.469206 Nov 24 18:17:59.213299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 224/454] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:17:58 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:17:59.221515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:59.222453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:17:59.230378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:59.230755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:59.231543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:17:59.232159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:17:59.384832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:59.398513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d4263cd-ba84-4b72-b37d-d0d6fc223296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.178508 Nov 24 18:17:59.402427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 231/455] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:00.062850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:00.064086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:00.070374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:00.071028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:00.072108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:00.072703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:00.220388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:00.228998 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:00.230793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:00.231941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-70b073df-729b-4b23-808d-d2909bc42a1a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.173428 Nov 24 18:18:00.243967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 225/456] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:00.414042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:00.415342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:00.422556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:00.423194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:00.424168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:00.424868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:00.614911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:00.623328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23c00169-a311-43aa-a852-35249d589683 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.212923 Nov 24 18:18:00.624488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 232/457] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:01.251317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:01.252625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:01.259342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:01.260031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:01.260987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:01.261570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:01.428391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:01.437590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:01.442524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:01.442524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0fbb937b-7a40-4d8d-af5b-3e01ee2d929c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.193929 Nov 24 18:18:01.442524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 226/458] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:01.660533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:01.662144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:01.669918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:01.672416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:01.673521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:01.674000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:01.851630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:01.861026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c5ff5a15-473b-4f2a-84e2-b865120d602a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.217204 Nov 24 18:18:01.869807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 233/459] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:02.459504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:02.460115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:02.466383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:02.466837 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:02.467606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:02.468036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:02.603215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:02.618321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:02.619894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:02.621468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-39440394-6a4c-45a4-8e48-e978f8d4a6c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.165668 Nov 24 18:18:02.643609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 227/460] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:18:02.879881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:02.880712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:02.889375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:02.889922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:02.890979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:02.892833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:03.075189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:03.084056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-56cf4541-b434-4f43-b524-1154d8a020aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.209492 Nov 24 18:18:03.084645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 234/461] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:03.660697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:03.661378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:03.672635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:03.672635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:03.672635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:03.672635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:03.806844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:03.815489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:03.816980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:03.818171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a36cb83-09fc-406b-ae49-cdeeb97c0457 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.161611 Nov 24 18:18:03.818719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 228/462] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:04.100857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:04.101461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:04.107698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:04.108145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:04.108908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:04.109336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:04.235876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:04.243537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4d315b04-18b0-4d8c-952c-066306b565cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.146236 Nov 24 18:18:04.244217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 235/463] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:04.836206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:04.836739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:04.843184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:04.843540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:04.844281 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:04.844707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:04.973788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:04.981370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:04.982904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:04.984038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7847ff8f-9528-46c5-bd94-608119843ad8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.151561 Nov 24 18:18:04.984588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 229/464] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:05.260814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:05.261426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:05.267810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:05.268256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:05.269034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:05.269475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:05.402337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:05.411138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aca490c8-787f-440a-b9f2-ed75841bcaf3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.153907 Nov 24 18:18:05.411710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 236/465] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:06.003199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:06.003710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:06.010063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:06.010538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:06.011312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:06.011749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:06.149557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:06.158279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:06.159790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:06.160952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-66ea6804-49fe-4c30-8c55-0e0aeeee4006 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1738 microversion: 2.20 time: 0.162362 Nov 24 18:18:06.161518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 230/466] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:06.428564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:06.429174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:06.435481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:06.435934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:06.436713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:06.437150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:06.638955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:06.647730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-930a7214-37de-4cac-ab2f-93850854d1fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1709 microversion: 2.1 time: 0.223067 Nov 24 18:18:06.648341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 237/467] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:07.180051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:07.180746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:07.186832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:07.187276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:07.188763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:07.189689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:07.332511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:07.340371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:07.341933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:07.343088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7c1d7d99-06b2-4b6d-95b7-5eb5dad57677 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1720 microversion: 2.20 time: 0.166779 Nov 24 18:18:07.343642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 231/468] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:07.668658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:07.669271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:07.676008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:07.676464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:07.677789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:07.677789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:07.808331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:07.816146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a610df0b-6a13-4c83-9347-58fb4ac6f276 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1713 microversion: 2.1 time: 0.151196 Nov 24 18:18:07.819665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 238/469] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:18:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:18:08.362812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:08.363481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:08.369660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:08.370140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:08.370915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:08.371355 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:08.501619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:08.509222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:08.510752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:08.511885 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4ff7892d-d9c3-41a8-aa92-5af8fb161da2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1720 microversion: 2.20 time: 0.153342 Nov 24 18:18:08.512435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 232/470] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:08.822456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-f1a68ab8-931b-484c-a0a2-f5e7628eeab1 req-17e3ef63-39d4-499d-bb8e-8428ee0df8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "name": "network-vif-unplugged", "status": "completed", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:18:08.824002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:18:08.824002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:18:08.831404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-f1a68ab8-931b-484c-a0a2-f5e7628eeab1 req-17e3ef63-39d4-499d-bb8e-8428ee0df8d7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:08.831849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-f1a68ab8-931b-484c-a0a2-f5e7628eeab1 req-17e3ef63-39d4-499d-bb8e-8428ee0df8d7 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:08.842475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-f1a68ab8-931b-484c-a0a2-f5e7628eeab1 req-17e3ef63-39d4-499d-bb8e-8428ee0df8d7 service nova] Creating event network-vif-unplugged:644fba12-d45b-488a-b7aa-07835df6583b for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 on hv-cinder-80403 Nov 24 18:18:08.847850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-f1a68ab8-931b-484c-a0a2-f5e7628eeab1 req-17e3ef63-39d4-499d-bb8e-8428ee0df8d7 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029004 Nov 24 18:18:08.852324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 239/471] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:18:09.530121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:09.530752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:09.539072 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:09.539529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:09.540345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:09.540791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:09.670437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:09.678587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:09.680088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:09.681232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-581f8cde-82ad-446d-a55a-18b73432e8c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1720 microversion: 2.20 time: 0.154727 Nov 24 18:18:09.681815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 233/472] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:10.700318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:10.701011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:10.707247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:10.707692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:10.708467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:10.708913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:10.850192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:10.857934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:10.859432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:10.860575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7b539376-aae3-4690-bc07-a7b15e8f9b0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1723 microversion: 2.20 time: 0.164854 Nov 24 18:18:10.861197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 240/473] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:10.878391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a319c8e-8bd1-44d8-b2d3-957b6af8d006"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:18:10.879471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:10.885794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:10.886251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:10.887038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:10.890165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:11.839955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-de43def1-d4f2-4094-9342-a305845e7ac9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.965348 Nov 24 18:18:11.847662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 234/474] 10.222.0.53 () {62 vars in 1363 bytes} [Wed Nov 24 18:18:10 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments => generated 188 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:18:11.949183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:18:11.949782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:11.956252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:11.956698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:11.957467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:11.958008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:12.155850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8522eb2e-c4af-48cb-a76c-2a54738ec9ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action" status: 202 len: 0 microversion: 2.20 time: 0.210398 Nov 24 18:18:12.156688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 241/475] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:18:11 2021] POST /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:18:12.165650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:12.166943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:12.173611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:12.174166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:12.175906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:12.176411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:12.308061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:12.316358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:12.317881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:12.319069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2cf2bacd-d832-46a8-984f-6e72f7aca9b5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1749 microversion: 2.20 time: 0.157370 Nov 24 18:18:12.319661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 235/476] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:13.338729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:13.339330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:13.345047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:13.346971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:13.346971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:13.347424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:13.479755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:13.489299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:13.490833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:13.491982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5b26e111-78ac-426d-8e9e-03a544262b54 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1749 microversion: 2.20 time: 0.157576 Nov 24 18:18:13.492549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 242/477] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:14.510125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:14.510729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:14.516944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:14.517389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:14.518193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:14.519319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:14.646170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:14.654203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:14.655690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:14.656817 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-862566c5-854e-4403-a5a5-65e0110d7e9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150443 Nov 24 18:18:14.657375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 236/478] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:15.676311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:15.676915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:15.683156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:15.683600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:15.684368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:15.684801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:15.821264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:15.830010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:15.835743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:15.835743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8f5a1f1-a83e-4098-bab0-8446e4b1c114 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.161254 Nov 24 18:18:15.835743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 243/479] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:16.852464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:16.853074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:16.859314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:16.859758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:16.860524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:16.860960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:16.989261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:16.997405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:16.998926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:17.000082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ef6c9d2d-4c05-48d7-81b1-89f67f9e1663 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151297 Nov 24 18:18:17.000644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 237/480] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:18.018782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:18.019399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:18.025699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:18.026168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:18.026928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:18.027429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:18.155768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:18.164028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:18.165529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:18.166695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-915dd13b-d534-4cdc-83b8-e888b6b6f530 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151747 Nov 24 18:18:18.167252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 244/481] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:19.184935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:19.185502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:19.192272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:19.192717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:19.193489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:19.193968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:19.322569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:19.330698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:19.333289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:19.334468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cf1ebadd-e2a5-4685-ba67-aabd573866dc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153206 Nov 24 18:18:19.335027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 238/482] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:19 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:20.352331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:20.352975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:20.359242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:20.359702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:20.360477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:20.360913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:20.487880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:20.496208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:20.497803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:20.498965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9f532b91-7f63-4f14-8b60-a2dad3fb676b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150289 Nov 24 18:18:20.499527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 245/483] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:20 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:21.517094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:21.517720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:21.524294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:21.524737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:21.525499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:21.525957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:21.655739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:21.663965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:21.665450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:21.666614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fcfea001-1d61-4dcc-8388-4f31e6ba0e78 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153010 Nov 24 18:18:21.667166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 239/484] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:22.684674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:22.685306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:22.691623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:22.692063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:22.692825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:22.693250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:22.828842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:22.838355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:22.839845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:22.841011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-58188f28-76ef-4f27-9278-b7c680c9a86d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159942 Nov 24 18:18:22.841572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 246/485] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:22 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:23.859937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:23.860482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:23.867553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:23.868007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:23.868784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:23.869222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:24.006650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:24.014837 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:24.016339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:24.017483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d4b5e43f-f6a8-43b1-9f1d-912e45c77fa6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.161341 Nov 24 18:18:24.018408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 240/486] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:25.036003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:25.036620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:25.042910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:25.043364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:25.044135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:25.044569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:25.171652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:25.180984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:25.182530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:25.183676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-22a9379f-22f5-4291-8c61-1b7542d9642c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151770 Nov 24 18:18:25.184237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 247/487] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:25 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:26.201956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:26.202559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:26.209379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:26.209839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:26.210601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:26.211025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:26.338115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:26.346134 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:26.347633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:26.348761 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-87f1c812-a3b7-4692-8c3e-4986ad3df465 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150477 Nov 24 18:18:26.349590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 241/488] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:27.367082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:27.367696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:27.373980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:27.374430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:27.375204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:27.375643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:27.504693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:27.513724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:27.515246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:27.516388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08c2b8bb-700d-4152-a400-b355ccc75c13 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152996 Nov 24 18:18:27.516949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 248/489] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:28.534470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:28.535079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:28.542078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:28.542530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:28.543299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:28.543736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:28.672319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:28.681177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:28.682709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:28.683856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5cfd6056-bbc7-4704-808e-17b349d6acb1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153194 Nov 24 18:18:28.684414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 242/490] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:29.702045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:29.702651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:29.709563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:29.710058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:29.710832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:29.711267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:29.839501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:29.847878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:29.849402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:29.850549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1ff6c96-3e37-49dd-8310-532efe5bb729 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152290 Nov 24 18:18:29.851131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 249/491] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:30.870916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:30.871520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:30.877749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:30.878231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:30.879011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:30.879446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:31.009819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:31.017978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:31.019502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:31.021249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6ad2cb03-85ea-433b-965e-c433c8d9fa99 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154971 Nov 24 18:18:31.021826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 243/492] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:32.038887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:32.039493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:32.046093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:32.046553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:32.047326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:32.047765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:32.176739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:32.185645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:32.187174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:32.188313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1adf4fe7-0131-48d1-8ab4-fe5c07630711 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153170 Nov 24 18:18:32.188860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 250/493] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:32 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:33.206682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:33.207574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:33.215298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:33.215848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:33.216707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:33.217215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:33.346844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:33.355332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:33.356832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:33.358010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-af0ef922-4b60-4e71-8a96-896e10923152 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155253 Nov 24 18:18:33.358585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 244/494] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:34.377166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:34.377785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:34.384785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:34.385228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:34.386026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:34.386463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:34.722924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:34.731784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:34.733291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:34.734475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1c74f575-7795-4138-8e86-412ac15e8175 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.360991 Nov 24 18:18:34.735035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 251/495] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:35.752894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:35.753504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:35.760283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:35.760735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:35.761509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:35.761968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:35.894699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:35.905186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:35.905339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:35.906506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-677f2c1f-b03f-4af8-880d-93371208aa24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157321 Nov 24 18:18:35.907087 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 245/496] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:36.924232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:36.925107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:36.931862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:36.932308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:36.933076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:36.933508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:37.062434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:37.070716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:37.072201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:37.073337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-893c40ca-4dcf-4370-9635-ef049073a48e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152818 Nov 24 18:18:37.073907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 252/497] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:36 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:38.093539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:38.094604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:38.102563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:38.103159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:38.103946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:38.104385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:38.249976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:38.261673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:38.263778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:38.265296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a803a43-2019-432f-92ea-81670e32cb3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.177399 Nov 24 18:18:38.265944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 246/498] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:39.285910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:39.287183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:39.293644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:39.294131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:39.294908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:39.295343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:39.425257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:39.433753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:39.435266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:39.436396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-169185d3-85ee-41cd-ba3d-b45c542e18b7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154165 Nov 24 18:18:39.441352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 253/499] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:39 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:40.454514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:40.455229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:40.461636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:40.462228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:40.463117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:40.463678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:40.596166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:40.604578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:40.606114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:40.607267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0f7fd83b-d960-4fdf-98b3-1e769d0e566a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156826 Nov 24 18:18:40.607819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 247/500] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:41.625867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:41.626459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:41.632665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:41.633104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:41.633903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:41.634767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:41.762604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:41.770637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:41.772902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:41.774134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-03f2945c-02bb-46d3-aec9-48f00bd50877 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152048 Nov 24 18:18:41.774701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 254/501] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:42.793239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:42.793857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:42.800413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:42.800883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:42.801647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:42.802144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:42.928917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:42.937187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:42.938720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:42.939871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5b62c646-c89e-44a9-a530-b08330c9858e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150378 Nov 24 18:18:42.940440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 248/502] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:43.958016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:43.958622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:43.964915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:43.965366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:43.966168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:43.966600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:44.094400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:44.103049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:44.104546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:44.105684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c473f1ee-6d75-4806-bf94-de62bc0693a3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151382 Nov 24 18:18:44.106271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 255/503] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:45.124242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:45.124877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:45.131711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:45.132240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:45.133011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:45.133443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:45.262576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:45.270702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:45.272534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:45.273684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-08e980e2-c85e-4839-9bfb-828c404f3ffb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153041 Nov 24 18:18:45.274273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 249/504] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:46.292173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:46.292775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:46.299058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:46.299809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:46.300585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:46.301019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:46.429443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:46.437632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:46.439333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:46.440482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d2e182b1-7d6f-419c-b643-367af0088cfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152025 Nov 24 18:18:46.441046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 256/505] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:46 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:47.459621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:47.460225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:47.466510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:47.466957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:47.467726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:47.468161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:47.598139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:47.606202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:47.607690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:47.608833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-55328651-8429-4956-bede-13c25e294ed9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152908 Nov 24 18:18:47.609383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 250/506] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:48.627665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:48.628264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:48.634581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:48.635028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:48.635786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:48.636214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:48.763927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:48.772594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:48.774103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:48.775240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-01bf8170-f9fc-466f-baa6-34ec98396d4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151246 Nov 24 18:18:48.775800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 257/507] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:48.869486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:48.870016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:48.876130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:48.876579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:48.877356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:48.877816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:48.963562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.objects.instance [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lazy-loading 'services' on Instance uuid 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 {{(pid=116731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:18:49.168851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-56d1d9e7-82f7-47c9-b524-3dee16789474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments/43060ca2-8552-4509-982d-aa32e1c9db3b" status: 202 len: 0 microversion: 2.1 time: 0.303041 Nov 24 18:18:49.169446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 251/508] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:18:48 2021] DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments/43060ca2-8552-4509-982d-aa32e1c9db3b => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:18:49.794193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:49.794705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:49.801254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:49.801726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:49.802521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:49.803296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:49.933349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:49.941483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:49.943014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:49.944674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-498603e1-d0de-4166-bf5c-35fe359a007c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154299 Nov 24 18:18:49.945235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 258/509] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:50.963555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:50.964262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:50.975257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:50.976079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:50.977476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:50.978295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:51.107695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:51.115973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:51.117473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:51.118653 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8a766213-ec98-4f82-ac69-b792894e7f6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159572 Nov 24 18:18:51.119201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 252/510] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:52.137047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:52.137651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:52.143859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:52.144300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:52.145056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:52.145486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:52.271214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:52.279985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:52.281484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:52.282662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8d7422cd-6941-4063-bdaa-178aaebdc287 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149258 Nov 24 18:18:52.283219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 259/511] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:53.300319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:53.300914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:53.307318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:53.307760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:53.308520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:53.309026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:53.443019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:53.451794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:53.453281 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:53.454455 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0590bee0-194b-4fca-98b7-f27c9ca435ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158041 Nov 24 18:18:53.455042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 253/512] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:53 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:54.472808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:54.473419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:54.480019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:54.480470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:54.481253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:54.481691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:54.611917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:54.620544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:54.622071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:54.623213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-525743c0-76a7-4c1c-9468-15a2e0e6c660 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154082 Nov 24 18:18:54.623767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 260/513] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:55.642137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:55.642736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:55.648929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:55.649363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:55.650149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:55.650577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:55.778390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:55.788051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:55.789793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:55.790972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a123948-c93d-4a6b-8ad2-f87f8efc094e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152479 Nov 24 18:18:55.791675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 254/514] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:56.810381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:56.810989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:56.817341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:56.817813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:56.818589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:56.819023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:56.946079 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:56.954170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:56.955663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:56.956804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c194c4e-88be-4cb9-a9a1-682c0d534f33 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150200 Nov 24 18:18:56.957361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 261/515] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:57.975867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:57.977123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:57.983427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:57.983871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:57.984634 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:57.985068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:58.110858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:58.118981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:58.120477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:58.121619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b626eacc-f741-46bf-a34b-0b174f12d0c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149421 Nov 24 18:18:58.122217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 255/516] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:18:59.139710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:18:59.140310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:18:59.146584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:59.146976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:59.147744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:18:59.149324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:18:59.279690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:59.287719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:59.289254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:18:59.290413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-41aa8f86-92d7-48ea-8cce-dff678a9eba2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154449 Nov 24 18:18:59.290964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 262/517] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:18:59 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:00.308588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:00.309101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:00.315305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:00.315753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:00.316518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:00.316953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:00.447293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:00.455382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:00.456885 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:00.458056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6d514532-cff0-4c1d-bcad-1b7a6f42cbc7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153603 Nov 24 18:19:00.458610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 256/518] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:01.477154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:01.477829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:01.488178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:01.488935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:01.489737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:01.490187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:01.632155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:01.642048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:01.645324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:01.645324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-122ea838-b87e-4cf3-9076-f7882b61c3eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.171754 Nov 24 18:19:01.646176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 263/519] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:02.681860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:02.682551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:02.689630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:02.690293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:02.691448 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:02.691904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:02.746351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:19:02.751745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:02.753886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:02.754563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:02.755622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:02.756156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:02.780366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'flavor' on Instance uuid 01eba79d-7c56-4ad4-8a6d-b3084fb1952f {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:19:02.826811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:02.835647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:02.837747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:02.839129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-449c08c8-6189-48b0-8ef7-3c87a5348310 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.178615 Nov 24 18:19:02.849791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 257/520] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:03.076659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a1e22670-a5f8-4140-abf7-c00aedcba0f3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action" status: 200 len: 32 microversion: 2.1 time: 0.334977 Nov 24 18:19:03.078001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 264/521] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:19:02 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action => generated 32 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 18:19:03.087892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:03.088510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:03.094658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:03.095119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:03.095896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:03.096495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:03.244699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:03.252335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b922f560-a260-4f7c-b31a-a4a51f1d8573 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.169488 Nov 24 18:19:03.252903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 258/522] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:03.859187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:03.859816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:03.866018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:03.866433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:03.867854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:03.868315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:03.999295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:04.007981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:04.009482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:04.010652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4473c440-1aef-47f9-8283-bd9234057d05 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156073 Nov 24 18:19:04.011207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 265/523] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:04.269666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:04.270392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:04.276814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:04.277266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:04.278146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:04.278583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:04.404429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:04.412104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0a94d184-848c-47fd-b3e2-e421f5eba93b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.146113 Nov 24 18:19:04.412672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 259/524] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:05.027995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:05.028602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:05.034886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:05.035357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:05.036120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:05.036556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:05.167349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:05.175817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:05.177320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:05.178533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6c9871f9-3345-49bd-85f6-3c19f3e2504f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154140 Nov 24 18:19:05.179128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 266/525] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:05.430219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:05.430876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:05.437104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:05.437648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:05.438447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:05.438888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:05.573346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:05.581099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8f38452a-572b-4487-8130-d3833d770282 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.154912 Nov 24 18:19:05.581665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 260/526] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:06.197440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:06.198079 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:06.204320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:06.204769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:06.205541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:06.206009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:06.334050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:06.342270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:06.343753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:06.344884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-49670eda-af70-462b-8cfe-f0daf4b83593 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151749 Nov 24 18:19:06.345443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 267/527] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:06 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:06.598432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:06.599044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:06.606629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:06.607105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:06.607895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:06.608325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:06.735408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:06.743955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6c923ed0-9400-4a4f-bb30-2bac4c467441 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.149152 Nov 24 18:19:06.744535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 261/528] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:07.152193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:19:07.152364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:19:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:19:07.363313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:07.363917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:07.370815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:07.371255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:07.372017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:07.372451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:07.499952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:07.508015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:07.509558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:07.510825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d056f288-5050-4111-8f63-d6f631c6c4e3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151179 Nov 24 18:19:07.511381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 268/529] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:07.761432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:07.762040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:07.768431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:07.768883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:07.769670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:07.770141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:07.901553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:07.909404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1c2ca256-775d-43ff-b247-cf2e8b189044 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.152125 Nov 24 18:19:07.910005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 262/530] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:08.529409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:08.530039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:08.536377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:08.536821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:08.537587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:08.538054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:08.670963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:08.679292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:08.680794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:08.681978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6238bc0c-ddfa-4f63-8bfd-bc525e061116 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156438 Nov 24 18:19:08.682544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 269/531] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:08.926856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:08.927472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:08.934280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:08.934724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:08.935494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:08.935926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:09.065330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:09.073860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-95d0433f-679d-4167-a771-cea3f6fbebba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.150780 Nov 24 18:19:09.074351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 263/532] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:09.700166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:09.700796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:09.707045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:09.707493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:09.708259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:09.708691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:09.837854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:09.846231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:09.847739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:09.848879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42c53bd6-68cc-44ea-bc5d-b3cb5bd299b0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153033 Nov 24 18:19:09.849479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 270/533] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:10.090515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:10.091052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:10.097018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:10.097467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:10.098273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:10.098708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:10.224442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:10.232199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-61580819-a16f-4dcb-b148-82a786d2aa17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.146039 Nov 24 18:19:10.232760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 264/534] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:10.867654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:10.868948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:10.875203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:10.875650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:10.876406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:10.876830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:11.009796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:11.018147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:11.019646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:11.020812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1fd3ed1c-62cf-46e1-9c46-7e3c1cb7d77f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156778 Nov 24 18:19:11.021372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 271/535] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:11.249279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:11.249913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:11.256356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:11.256809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:11.257582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:11.258049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:11.390905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:11.398551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a58ae504-62a3-48e0-9877-bda579892c41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.152874 Nov 24 18:19:11.399167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 265/536] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:19:12.040656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:12.041408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:12.047589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:12.048032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:12.048790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:12.049218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:12.176821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:12.185653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:12.187184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:12.188331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bedf0f79-4fd6-4516-b58a-7e26b88f6a91 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152026 Nov 24 18:19:12.188882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 272/537] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:12.414981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:12.416057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:12.422306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:12.422758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:12.423558 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:12.423993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:12.552846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:12.560816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ac92515d-cf3d-4936-95d8-b3f679c77785 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.149444 Nov 24 18:19:12.561411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 266/538] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:13.205627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:13.206406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:13.213350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:13.213810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:13.214576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:13.215002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:13.340189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:13.348249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:13.349731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:13.350885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5b19895b-5a32-4d88-b8b7-6ab9f3bd6eb8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148894 Nov 24 18:19:13.351431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 273/539] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:13.578765 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:13.579407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:13.585607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:13.586085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:13.586916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:13.587419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:13.713106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:13.720974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2a035860-0f17-4f84-b23e-1adcf244050f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.145934 Nov 24 18:19:13.721542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 267/540] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:14.369393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:14.369965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:14.376142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:14.376590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:14.377364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:14.377869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:14.511967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:14.520030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:14.521535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:14.522714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-daa5a6f4-cab6-4830-90b3-20103f3af243 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157310 Nov 24 18:19:14.523274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 274/541] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:14.737822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:14.738438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:14.745001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:14.745468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:14.746410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:14.747055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:14.884732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:14.897978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fb8e3b8f-2bf0-412b-92b3-357ce78ad436 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.163604 Nov 24 18:19:14.898832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 268/542] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:15.543030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:15.543030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:15.547681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:15.548121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:15.548886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:15.549620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:15.681889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:15.690065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:15.691602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:15.692758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef1a328b-5cd1-425b-b58d-59015d46b634 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155698 Nov 24 18:19:15.693317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 275/543] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:15.917898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:15.918507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:15.925062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:15.925512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:15.926323 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:15.926788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:16.054253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:16.062931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-622f2637-d21a-4592-998f-b1109640e433 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.148823 Nov 24 18:19:16.063505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 269/544] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:16.711561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:16.712928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:16.719116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:16.719569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:16.720345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:16.720780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:16.855201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:16.863365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:16.864868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:16.866036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9969106-6825-4ef2-b350-2c0060f2075a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158098 Nov 24 18:19:16.866595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 276/545] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:19:17.079962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:17.080504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:17.086691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:17.088233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:17.089010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:17.089443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:17.221058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:17.228909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cbcc0bcc-56d2-4a27-8ea0-da677df2bc60 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.152645 Nov 24 18:19:17.229479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 270/546] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:17.884677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:17.885285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:17.891524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:17.891975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:17.892749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:17.893249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:18.022159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:18.031098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:18.032600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:18.033742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a2c1908c-646a-4b00-8903-f00e89d005a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153329 Nov 24 18:19:18.034327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 277/547] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:18.246180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:18.246813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:18.253070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:18.253493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:18.254432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:18.254868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:18.384442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:18.392013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f2752ad1-3c81-44c9-9968-fe302def444e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.149899 Nov 24 18:19:18.392569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 271/548] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:19.052764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:19.053356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:19.059671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:19.060049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:19.060802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:19.061229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:19.191300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:19.199895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:19.201399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:19.202580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2006fdb5-6909-4296-b956-59772f95c5af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153709 Nov 24 18:19:19.203143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 278/549] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:19 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:19.408354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:19.408971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:19.415261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:19.415709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:19.416507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:19.416979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:19.547533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:19.555391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e0c7a67d-419a-4e80-838e-3e62cbf4a89c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.150656 Nov 24 18:19:19.555951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 272/550] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:20.221204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:20.221851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:20.228094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:20.228541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:20.230130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:20.230576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:20.357063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:20.365633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:20.367169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:20.368322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ceaeef36-2f45-4205-823a-43da07fcbc97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150818 Nov 24 18:19:20.368882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 279/551] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:20 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:20.573559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:20.574244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:20.580571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:20.581238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:20.582243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:20.582701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:20.707646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:20.716011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-51e52fd7-c186-448c-9731-d7e49905e09c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.147067 Nov 24 18:19:20.716581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 273/552] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:21.386821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:21.393608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:21.393608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:21.394086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:21.394866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:21.395301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:21.526474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:21.534616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:21.536117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:21.537288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e94444cf-e123-4ca0-97cc-81a3746ea3b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154466 Nov 24 18:19:21.537898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 280/553] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:21.732784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:21.733395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:21.739733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:21.740113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:21.740879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:21.741309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:21.871869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:21.879554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3cf63e36-f1f5-4c07-98af-9c851b53d1e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.150970 Nov 24 18:19:21.880118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 274/554] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:22.555458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:22.556055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:22.562529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:22.563009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:22.563794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:22.564230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:22.700454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:22.708618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:22.710196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:22.711286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1b7f8579-61fe-4bd4-a8ba-e1341f038f9a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159518 Nov 24 18:19:22.711836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 281/555] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:22 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:22.896271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:22.896879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:22.904235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:22.904731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:22.905509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:22.905970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:23.038630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:23.047375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-936b29e4-8698-4b42-a83c-4087528a8e6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.154868 Nov 24 18:19:23.047938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 275/556] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:23.730480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:23.731085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:23.737361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:23.737851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:23.738619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:23.739057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:23.870215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:23.878837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:23.880339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:23.881476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a3f3fb3e-3f20-4da8-a425-79a58fbb062d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155211 Nov 24 18:19:23.882089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 282/557] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:24.065292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:24.065954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:24.072403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:24.073442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:24.074253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:24.074683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:24.203153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:24.210803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ad8e846-242c-4bbd-a16b-225fa12c7ee9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.149081 Nov 24 18:19:24.218341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 276/558] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:24.900458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:24.902080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:24.907798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:24.908233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:24.908988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:24.909416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:25.040691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:25.050196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:25.051697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:25.052842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f7518dc5-0604-4036-9990-d53b7258cd2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156194 Nov 24 18:19:25.053393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 283/559] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:24 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:25.227911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:25.228506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:25.234859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:25.235312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:25.236084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:25.236532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:25.367259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:25.375735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fc7b8567-c353-4092-bef8-b74093267da8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.151443 Nov 24 18:19:25.376309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 277/560] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:26.070121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:26.070732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:26.077486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:26.077915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:26.078688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:26.079126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:26.206362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:26.214641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:26.216146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:26.217290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-405f422b-335a-4557-aefb-f809f75d45a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150851 Nov 24 18:19:26.217870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 284/561] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:26.393878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:26.394427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:26.401202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:26.401663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:26.402467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:26.402907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:26.530785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:26.538378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cc882962-9720-408e-800a-a4424c92c165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.148378 Nov 24 18:19:26.538949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 278/562] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:27.235485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:27.236080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:27.242180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:27.242622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:27.243373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:27.243801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:27.369062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:27.377262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:27.378765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:27.379900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-962071fc-bc08-4fa6-b8db-deb2ced2b5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.147997 Nov 24 18:19:27.380437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 285/563] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:27.556064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:27.556895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:27.563329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:27.563780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:27.564558 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:27.564995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:27.692443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:27.701193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a0517b91-0be0-4c9d-ba70-897e30ac8ffd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.148787 Nov 24 18:19:27.701794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 279/564] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:28.398583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:28.399130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:28.406103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:28.406547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:28.407312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:28.407736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:28.537849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:28.546666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:28.548169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:28.549296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3bd71560-fa06-46e6-8944-4688a0b71995 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154420 Nov 24 18:19:28.550138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 286/565] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:28.718720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:28.719325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:28.725628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:28.726103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:28.726874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:28.727310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:28.858047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:28.866839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ea095fa-678d-41d0-aedb-48fc5f5a0c35 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.151692 Nov 24 18:19:28.867410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 280/566] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:29.568436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:29.569046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:29.576097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:29.576548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:29.577346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:29.577798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:29.704846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:29.712894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:29.715701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:29.716830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b45b49e5-a4a8-4386-bd73-5352688f154a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152107 Nov 24 18:19:29.717388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 287/567] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:29.882968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:29.883564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:29.890510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:29.890945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:29.891705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:29.892142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:30.017119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:30.024710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bec86351-4d54-4f43-8620-0de4ac77e6d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.145328 Nov 24 18:19:30.025271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 281/568] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:30.735246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:30.735845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:30.742071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:30.742510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:30.743268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:30.743698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:30.873194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:30.882669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:30.884161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:30.886515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f35cd522-6d0d-41c4-9333-e136735f7c97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153988 Nov 24 18:19:30.887106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 288/569] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:31.041626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:31.042266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:31.048477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:31.048926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:31.050020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:31.050460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:31.179948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:31.187776 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fc8507f9-1416-4614-9ba5-de58f0945015 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.149808 Nov 24 18:19:31.188346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 282/570] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:31.905520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:31.906147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:31.912465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:31.912909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:31.913721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:31.914178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.044575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.052949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.054492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.055640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-055e4ffe-e5f8-4867-9053-434d8e4f6bd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154592 Nov 24 18:19:32.056192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 289/571] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:32.205223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:32.205868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:32.212087 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.212535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.213406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.213940 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.342438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.350216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e7f8abc9-cabd-420c-a6a7-572f3170ebe3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1548 microversion: 2.1 time: 0.149075 Nov 24 18:19:32.350790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 283/572] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:32.366328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:32.367081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:32.373417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.373919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.374699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.375138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.495586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] HTTP exception thrown: Cannot 'detach_volume' instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f while it is in vm_state rescued Nov 24 18:19:32.496180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Returning 409 to user: Cannot 'detach_volume' instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f while it is in vm_state rescued {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:19:32.497005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f4d657a-9876-482e-832f-fd30c47be44c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments/99768356-a6b3-4749-9dfa-f3e4c550a05b" status: 409 len: 152 microversion: 2.1 time: 0.134488 Nov 24 18:19:32.497550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 290/573] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:19:32 2021] DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments/99768356-a6b3-4749-9dfa-f3e4c550a05b => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 18:19:32.505628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:19:32.506193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:32.512949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.513425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.514229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.514665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.757413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-713f523c-d9d7-4804-ba87-2177fe113eb2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action" status: 202 len: 0 microversion: 2.1 time: 0.255163 Nov 24 18:19:32.758067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 284/574] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:19:32 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:19:32.766610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:32.767218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:32.773988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.774444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.775230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:32.775668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:32.936301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.944097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a4df19dd-6b5d-488f-834f-4687d697ba27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1556 microversion: 2.1 time: 0.181147 Nov 24 18:19:32.944901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 291/575] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:33.075157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:33.075969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:33.082063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:33.082516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:33.083293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:33.083730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:33.216439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:33.224801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:33.226316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:33.227564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6f8953e0-a489-4338-838d-e30a6f56262d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157172 Nov 24 18:19:33.228108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 285/576] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:33.961063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:33.962202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:33.969027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:33.969480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:33.970427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:33.970864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:34.197368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:34.206277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bede7344-022d-4126-aa8d-dd065f9656b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1556 microversion: 2.1 time: 0.248873 Nov 24 18:19:34.206844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 292/577] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:34.247566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:34.248180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:34.254423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:34.254874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:34.255651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:34.256084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:34.387272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:34.395638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:34.397129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:34.398323 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-939be7f3-8465-42de-bf8d-2c23b24d4206 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155153 Nov 24 18:19:34.398876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 286/578] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:35.224063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:35.224836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:35.231251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.231700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.232483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.232947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.363301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:35.371854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ffde1175-54d4-4dc6-ba19-d94308f154ec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1562 microversion: 2.1 time: 0.151480 Nov 24 18:19:35.372465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 293/579] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:35.416447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:35.417095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:35.433603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.433603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.433603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.433603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.441000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:35.441613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:35.448161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.450230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.452781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.453232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.570233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:35.578891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'services' on Instance uuid 01eba79d-7c56-4ad4-8a6d-b3084fb1952f {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:19:35.581868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:35.583595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:35.584868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-315ebe90-6d59-4991-8a60-94a187b639db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.172195 Nov 24 18:19:35.585590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 287/580] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:35.801559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-571b0aca-d0b0-4f59-ac51-ce8397c26446 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments/99768356-a6b3-4749-9dfa-f3e4c550a05b" status: 202 len: 0 microversion: 2.1 time: 0.363513 Nov 24 18:19:35.802627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 294/581] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:19:35 2021] DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments/99768356-a6b3-4749-9dfa-f3e4c550a05b => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:19:35.814686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:35.816463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:35.835326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.835326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.835326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:35.835326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:35.858591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7849f672-1bd8-475d-bbef-f4a9380a503f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051338 Nov 24 18:19:35.863069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 288/582] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:36.604248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:36.605555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:36.612060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:36.612506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:36.613269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:36.613700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:36.741905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:36.750093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:36.755343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:36.755343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1edf1381-c8fa-4955-84d4-84e2329e63c4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152462 Nov 24 18:19:36.755343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 295/583] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:36 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:36.870220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:36.871623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:36.877958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:36.878549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:36.879333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:36.879767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:36.910265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-82bdcd18-da9e-410b-bbe7-fd90e57a7123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Nov 24 18:19:36.910826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 289/584] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:37.771879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:37.772477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:37.779451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:37.785820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:37.785820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:37.785820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:37.914206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:37.922073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:37.923070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:37.923901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:37.925676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:37.926864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02d80b7e-418b-4d38-8708-c5360798185c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158734 Nov 24 18:19:37.928389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 296/585] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:37.931353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:37.931833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:37.932637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:37.933128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:37.966276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-35d9f860-7e02-45a9-aa3b-60a7feb4610f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Nov 24 18:19:37.966851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 290/586] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:19:38.952364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:38.952965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:38.959195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:38.959635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:38.960396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:38.960819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:38.977498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:38.978424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:38.984625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:38.985061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:38.985851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:38.986280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:39.015591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a1026bc1-715c-43f5-8165-35ad739ccf9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Nov 24 18:19:39.016337 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 291/587] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:19:39.088161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:39.096819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:39.098330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:39.099444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f7fe11a2-736e-403b-8df4-821f0f1b8ee0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151018 Nov 24 18:19:39.099996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 297/588] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:40.026852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:40.027893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:40.034191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:40.034638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:40.035408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:40.035838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:40.065958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d85e9952-dfa6-4bf6-9e4c-ae0f25dede9b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Nov 24 18:19:40.066512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 292/589] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:40.117995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:40.118600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:40.125170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:40.125617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:40.126425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:40.126865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:40.259281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:40.268060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:40.269555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:40.270714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3244a000-96bd-4c72-a4ab-4882e6e0ab56 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156312 Nov 24 18:19:40.271272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 298/590] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:41.078150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:41.078988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:41.084874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:41.085327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:41.086129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:41.086567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:41.114957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1aa159e3-c5ce-4ada-a5fb-7c57ce03d295 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 Nov 24 18:19:41.115501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 293/591] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:41.289438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:41.290069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:41.296386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:41.296840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:41.297608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:41.298070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:41.431280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:41.439961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:41.441442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:41.442604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-894001d5-1f5e-4819-969f-87403980cfe5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156953 Nov 24 18:19:41.443163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 299/592] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:42.126713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:42.127538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:42.133639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:42.134114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:42.134874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:42.135309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:42.163587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c6b37c28-7816-409b-b8c2-015e654860e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Nov 24 18:19:42.164117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 294/593] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:42.461709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:42.462338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:42.468359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:42.468768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:42.469541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:42.470140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:42.596247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:42.604401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:42.605926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:42.607715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff366e1a-6a93-4165-a991-4de3a9944ae6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149691 Nov 24 18:19:42.608270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 300/594] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:43.176375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:43.177280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:43.183467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:43.183911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:43.185355 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:43.185915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:43.213471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-21107cd2-7fc9-4e1e-86ee-b2a9c29bf864 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041062 Nov 24 18:19:43.214049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 295/595] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:43.625903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:43.626508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:43.632687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:43.633131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:43.633926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:43.634361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:43.776467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:43.786671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:43.788190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:43.790162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8bb1c434-e4d7-4bb0-8e40-b46d2ba2b08d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.168158 Nov 24 18:19:43.790725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 301/596] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:44.224814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:44.225651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:44.231916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:44.232363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:44.233138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:44.233574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:44.261862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-15531907-c2fd-4d9d-9ca7-4a78cb71e7e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040888 Nov 24 18:19:44.262407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 296/597] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:44.811093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:44.811654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:44.817928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:44.818381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:44.819153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:44.819591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:44.948695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:44.957116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:44.958658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:44.959800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7fc9a96d-f4be-4395-98a0-7f67b315839f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153166 Nov 24 18:19:44.960364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 302/598] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:19:45.273742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:45.274671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:45.281599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:45.282105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:45.282882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:45.283319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:45.311589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7e62f018-66c0-47e5-a7b3-9091bf5c62a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Nov 24 18:19:45.312130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 297/599] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:45.978437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:45.979043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:45.985644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:45.986043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:45.986824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:45.987263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:46.123059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:46.131514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:46.133000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:46.134150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-586f6fa0-87bb-40e8-ad40-027d3071a69d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159365 Nov 24 18:19:46.134710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 303/600] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:19:46.322658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:46.323564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:46.330389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:46.330830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:46.331594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:46.332024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:46.359667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ff8d5fc-c356-45a3-b9fd-3069809fadb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040664 Nov 24 18:19:46.360204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 298/601] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:47.152553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:47.153170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:47.159864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:47.160312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:47.161076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:47.161502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:47.293159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:47.302131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:47.303621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:47.304759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e49d0a3e-82c9-4993-9bdb-fb4fb211ee1c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155839 Nov 24 18:19:47.305315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 304/602] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:47.370677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:47.371585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:47.377886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:47.378329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:47.379093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:47.379519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:47.408622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5be6e372-17e9-4990-bc07-97659b0c320b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 Nov 24 18:19:47.409211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 299/603] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:48.322992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:48.323600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:48.329872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:48.330323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:48.331090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:48.331529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:48.420490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:48.421489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:48.427908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:48.428357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:48.429135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:48.429573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:48.458913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-14ccf263-3abf-4580-b589-774901057663 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Nov 24 18:19:48.459469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:48.459600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 300/604] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:19:48.467647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:48.469133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:48.470365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-241d6c12-68e0-498a-aa7e-2334c2895e0a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151098 Nov 24 18:19:48.470908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 305/605] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:49.470705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:49.471609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:49.477819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:49.478264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:49.479029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:49.479457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:49.488246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:49.488907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:49.495094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:49.495542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:49.496316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:49.496755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:49.508907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c02a93de-14b0-4e1b-bc76-d5e1b4b4a67e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 Nov 24 18:19:49.509478 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 301/606] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:49.627728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:49.635786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:49.637292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:49.638703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-54b0ea83-8d04-48ff-abaa-fd36f8c3db38 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154075 Nov 24 18:19:49.639264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 306/607] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:19:50.520550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:50.521490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:50.527769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:50.528225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:50.529744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:50.530202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:50.558946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-08d8fdb2-2af6-4a51-8e1e-66e99b70a9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Nov 24 18:19:50.559529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 302/608] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:50.657167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:50.657781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:50.663956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:50.664400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:50.665169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:50.665609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:50.793040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:50.801465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:50.802997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:50.804132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0ad8ac67-2574-4ede-bb6b-2a589a480561 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151746 Nov 24 18:19:50.804690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 307/609] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:51.571549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:51.572747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:51.579596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:51.580041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:51.580807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:51.581246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:51.611053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-57459168-6b4f-444e-80f7-353806c88f36 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Nov 24 18:19:51.611599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 303/610] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:51.822790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:51.823339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:51.829535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:51.830015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:51.830789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:51.831271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:51.963866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:51.972777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:51.974302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:51.975417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee9119ae-f2c6-4186-87c5-fe8a138b7ec5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156440 Nov 24 18:19:51.975973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 308/611] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:52.623105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:52.624056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:52.630333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:52.630785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:52.631560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:52.631997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:52.661550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cadf4ca6-0541-4dee-bb8e-144e82f2b2e2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Nov 24 18:19:52.662134 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 304/612] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:52.993463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:52.994104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:53.000535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:53.000985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:53.001769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:53.002263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:53.128668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:53.136714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:53.139090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:53.140236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d47119f-de6a-4be2-8bf6-c96e425e9cac tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150464 Nov 24 18:19:53.140815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 309/613] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:53.672725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:53.673631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:53.680320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:53.680768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:53.681544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:53.682006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:53.710895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9dabadfd-3bd1-46cb-958b-5a43edf408cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Nov 24 18:19:53.711440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 305/614] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:54.158598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:54.159142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:54.165300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:54.165750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:54.166557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:54.166993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:54.295176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:54.303621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:54.305148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:54.306331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dbb4085b-9284-4717-880c-e7c37d723578 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151455 Nov 24 18:19:54.306891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 310/615] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:54.723097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:54.723929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:54.730328 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:54.730783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:54.732273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:54.732746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:54.761063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-473bfbad-991f-4124-8032-69ebe6d57cef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Nov 24 18:19:54.761618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 306/616] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:55.324633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:55.325146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:55.331345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:55.331793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:55.332551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:55.332981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:55.478924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:55.488549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:55.490100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:55.491244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d3778b0-9a38-4de8-ba53-64f024aabf21 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.170346 Nov 24 18:19:55.491803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 311/617] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:55.774231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:55.775141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:55.782240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:55.782695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:55.783530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:55.783967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:55.815396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c055fd10-174f-4a3c-974b-a30c85071b4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Nov 24 18:19:55.815951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 307/618] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:56.510489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:56.511102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:56.518073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:56.518523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:56.519299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:56.527681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:56.648737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:56.657699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:56.659215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:56.660354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-47808a46-4620-439f-83c1-b1062b5c1bcd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153519 Nov 24 18:19:56.660916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 312/619] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:56.827677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:56.828520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:56.834846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:56.835293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:56.836068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:56.836504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:56.865343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a864bbf8-0f81-4b68-8b39-691b02563029 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Nov 24 18:19:56.865921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 308/620] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:57.678661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:57.679272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:57.685676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:57.686160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:57.686936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:57.687373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:57.819309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:57.827406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:57.828896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:57.830060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8acc1693-7107-464f-9c71-f7fd369801db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154997 Nov 24 18:19:57.830616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 313/621] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:57.876690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:57.877598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:57.883836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:57.884280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:57.885045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:57.885477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:57.914801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d56a2020-5637-4a6b-933a-e9d0f29213ed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Nov 24 18:19:57.915337 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 309/622] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:58.847807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:58.848350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:58.854505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:58.854942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:58.855700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:58.856132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:58.926324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:58.927237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:58.933096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:58.933742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:58.934321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:58.935812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:58.967102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c2b05b10-7635-492e-834f-29e529cdf516 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Nov 24 18:19:58.967908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 310/623] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:19:58.985628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:58.993656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:58.995160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:58.996283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b7a93b54-dc7e-4cf1-b961-e445936a1647 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152266 Nov 24 18:19:58.996837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 314/624] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:19:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:19:59.978659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:59.979573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:19:59.986289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:59.986737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:19:59.987504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:19:59.987937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:00.015393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:00.016017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:00.018813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ea08e848-ad7e-4d60-adb6-b9ecb2ce345b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Nov 24 18:20:00.019392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 311/625] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:19:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:00.022707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:00.023147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:00.023915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:00.024344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:00.148895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:00.156909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:00.158420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:00.159538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-686200a4-9c97-4e18-81d3-8d263e5d33a5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148416 Nov 24 18:20:00.160088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 315/626] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:01.030830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:01.031849 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:01.038641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:01.039092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:01.039870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:01.040373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:01.069353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-20df5216-aa41-41b0-827e-e5a0db09bc98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Nov 24 18:20:01.069922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 312/627] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:01.177864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:01.178496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:01.184842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:01.185297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:01.186094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:01.186534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:01.321550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:01.331366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:01.332861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:01.336838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff25f918-b6c8-4146-8a53-e34ea132691e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.160065 Nov 24 18:20:01.336838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 316/628] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:02.081076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:02.082041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:02.088614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:02.089316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:02.090298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:02.090784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:02.119208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b23f30b8-480d-40c1-9fc8-fdc63e0ff5fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Nov 24 18:20:02.119770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 313/629] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:02.353915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:02.354543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:02.360760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:02.361215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:02.362016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:02.362453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:02.493310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:02.501464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:02.503015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:02.504167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e40d46d7-24e1-4c6f-97ef-fcea91b92fb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154021 Nov 24 18:20:02.504726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 317/630] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:03.131419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:03.132260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:03.139266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:03.139719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:03.140491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:03.140927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:03.168730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d539cfce-ecbd-44ef-b45f-ba144f8c6e87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Nov 24 18:20:03.169487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 314/631] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:03.523002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:03.523612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:03.530014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:03.533372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:03.533372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:03.533372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:03.662490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:03.671788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:03.673218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:03.674654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ec9f2a87-cb0a-42d4-b576-8a2957c03308 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155057 Nov 24 18:20:03.675211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 318/632] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:04.180649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:04.181561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:04.188577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:04.189022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:04.189812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:04.190253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:04.218166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ed3e261-bdad-4678-ba9a-631bc7904f56 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Nov 24 18:20:04.218709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 315/633] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:04.693174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:04.693793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:04.700509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:04.701049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:04.701832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:04.702261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:04.829842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:04.837945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:04.839424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:04.841324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1bac4c59-0f26-451b-988e-811767a9993a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151212 Nov 24 18:20:04.842497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 319/634] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:05.229323 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:05.230268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:05.237234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:05.237681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:05.238489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:05.238928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:05.273676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3bc2a9e3-00fb-4ff5-9634-5c3bcc00a082 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048027 Nov 24 18:20:05.274254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 316/635] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:05.859717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:05.861611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:05.866581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:05.867025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:05.867791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:05.868225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:06.011833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:06.017910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:06.019637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:06.020781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-60bc7852-1ace-4ff2-bbac-e2f4b58d2d8c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.165199 Nov 24 18:20:06.021330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 320/636] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:06.284654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:06.285604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:06.291842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:06.292283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:06.293047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:06.293476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:06.323706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-39ca77a9-7f4a-451f-96b9-1ff9fd17ba54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042855 Nov 24 18:20:06.324248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 317/637] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:07.039094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:07.039557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:07.046445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:07.046756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:07.047521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:07.047948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:07.178322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:07.187548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:07.189041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:07.190213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c22fc2d7-d266-4461-bda3-51ad3a19c9ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154928 Nov 24 18:20:07.190773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 321/638] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:20:07.335276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:07.336218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:07.343045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:07.343491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:07.344259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:07.344695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:07.373199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c809d455-d58f-4843-8415-10b1d1a91ad0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 Nov 24 18:20:07.373745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 318/639] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:08.208003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:08.208598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:08.214754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:08.215195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:08.215949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:08.216373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:08.343481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:08.351695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:08.353103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:08.354255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d4ed5a07-11da-4448-a985-fb50042b7a6a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149893 Nov 24 18:20:08.354809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 322/640] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:08.384162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:08.385083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:08.391946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:08.392397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:08.393173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:08.393615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:08.422141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-706a8482-d4ff-4747-89ef-4580ad64c40e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Nov 24 18:20:08.422696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 319/641] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:09.372379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:09.372919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:09.379066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:09.379510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:09.380269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:09.380698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:09.433690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:09.434645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:09.441429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:09.441912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:09.442693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:09.443131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:09.475877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9eeeefa5-275d-44b8-9514-4f5d60e6b9f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Nov 24 18:20:09.476468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 320/642] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:09.710153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:09.718792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:09.720345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:09.721520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b6b2bbdd-595c-43c0-8934-6d93d0bca2e9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.352908 Nov 24 18:20:09.722092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 323/643] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:10.488243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:10.489163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:10.495025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:10.495475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:10.496251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:10.496688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:10.525102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5e95cd84-8c5a-446e-80f7-d6399b8fb196 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Nov 24 18:20:10.525648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 321/644] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:10.739832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:10.740390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:10.746305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:10.746754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:10.747530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:10.748095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:10.876382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:10.884554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:10.886081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:10.887246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-03a1cb98-4c52-4649-bf8c-e710497084db tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151358 Nov 24 18:20:10.887795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 324/645] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:11.536496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:11.537409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:11.543946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:11.544389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:11.545327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:11.545778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:11.574228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ca14a183-dcd7-4d93-b76b-ab4eaf3b47e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Nov 24 18:20:11.574926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 322/646] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:11.905511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:11.906147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:11.912354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:11.912803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:11.913575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:11.914034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:12.043209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:12.052826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:12.054343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:12.055503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d28dae87-519d-460f-bea9-b52525143361 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153868 Nov 24 18:20:12.056060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 325/647] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:11 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:12.586086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:12.586998 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:12.593676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:12.594157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:12.594932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:12.595369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:12.625449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d83f325c-0cfc-455b-afa4-4c5484631b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Nov 24 18:20:12.626059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 323/648] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:13.073162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:13.073789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:13.080226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:13.080679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:13.081452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:13.081925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:13.206097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:13.214181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:13.215684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:13.216885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7705486-0577-47f0-82d2-eb10ae3c9575 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.147347 Nov 24 18:20:13.217443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 326/649] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:13.636318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:13.637234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:13.644137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:13.644584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:13.645367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:13.645944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:13.675400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-32a99e26-f9a5-4b9f-b2ff-1280df1f67bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 Nov 24 18:20:13.675956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 324/650] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:14.235861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:14.236471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:14.242746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:14.243201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:14.243969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:14.244403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:14.374208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:14.382854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:14.384464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:14.385586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f1a06ae3-e5eb-4b03-90c8-fc510b1769f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153527 Nov 24 18:20:14.386168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 327/651] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:14.686611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:14.687577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:14.693694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:14.694169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:14.694976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:14.695405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:14.725397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-02de9add-115f-4361-9313-ca4118d673ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Nov 24 18:20:14.726017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 325/652] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:15.403612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:15.404442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:15.413774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:15.413774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:15.413774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:15.413774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:15.548991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:15.558164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:15.559212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:15.560897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5f107325-55ac-4e48-8f66-69824c3bb004 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.160413 Nov 24 18:20:15.561661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 328/653] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:15.737446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:15.738432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:15.744749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:15.745225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:15.746038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:15.746484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:15.775253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0ac66b38-3457-4e05-adf3-1065835e9c4c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Nov 24 18:20:15.775807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 326/654] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:16.579950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:16.580607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:16.586845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:16.587289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:16.588055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:16.588485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:16.716690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:16.724907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:16.726448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:16.727589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-01aaf14a-d251-48dd-9d86-b301e4b83142 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152408 Nov 24 18:20:16.728143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 329/655] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:16.786563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:16.787463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:16.793642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:16.794115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:16.795719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:16.795895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:16.825059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-63e2199a-e97c-43cb-8a2b-e66bd7e59f9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Nov 24 18:20:16.825600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 327/656] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:17.745692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:17.746237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:17.752450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:17.752889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:17.753646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:17.754099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:17.836914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:17.837865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:17.844356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:17.844809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:17.845591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:17.846052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:17.875255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5cecd8fa-115b-442f-a295-cba91cafb6aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042270 Nov 24 18:20:17.875818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 328/657] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:17.884407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:17.893300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:17.894807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:17.896007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-73a907da-6450-4e6f-886c-3def8c376c23 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154010 Nov 24 18:20:17.896561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 330/658] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:18.886514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:18.887331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:18.894159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:18.894601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:18.895360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:18.895784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:18.913367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:18.914021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:18.920559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:18.921040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:18.921811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:18.922240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:18.925264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a6a77ad1-f35f-499b-845a-d4794130cf27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Nov 24 18:20:18.926021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 329/659] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:19.048073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:19.056314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:19.057813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:19.058941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-099ccdb0-b3ab-4a22-8592-ffd78166b4f1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149183 Nov 24 18:20:19.059491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 331/660] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:19.936651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:19.937565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:19.943854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:19.944341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:19.945159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:19.945597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:19.976454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a1ff7829-3482-455e-884e-fb93781d1cbb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Nov 24 18:20:19.977014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 330/661] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:20.078029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:20.078638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:20.084820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:20.085264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:20.086060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:20.086496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:20.210878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:20.219193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:20.220590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:20.221736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f0372c4b-8114-4aac-b12e-c96d0e26c89d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148114 Nov 24 18:20:20.222324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 332/662] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:20 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:20.988419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:20.989334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:20.995754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:20.996202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:20.996974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:20.997407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:21.025690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-af7ed469-d025-4ac2-ad8b-efacffb820db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 Nov 24 18:20:21.026273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 331/663] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:21.240112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:21.240638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:21.246843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:21.247285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:21.248066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:21.248493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:21.384454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:21.394905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:21.395677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:21.396814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-facf1950-3b7e-4f5b-a7fa-fc799046a125 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.160466 Nov 24 18:20:21.397367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 333/664] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:22.037679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:22.038663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:22.045094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:22.045699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:22.046514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:22.046953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:22.075292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6b3633a0-df26-4075-a239-5ba81c9e46d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 Nov 24 18:20:22.076393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 332/665] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:22.415148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:22.415762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:22.422739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:22.423187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:22.423954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:22.424653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:22.553039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:22.561381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:22.562910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:22.564065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0354fed7-b446-4102-82fc-ab91d56f20d2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152576 Nov 24 18:20:22.564625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 334/666] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:22 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:20:23.087124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:23.088078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:23.094978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:23.095423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:23.096192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:23.096620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:23.125147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6fd303a3-eba8-438c-b2d5-45b50bd7d664 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Nov 24 18:20:23.125680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 333/667] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:23.581786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:23.582398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:23.588609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:23.589051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:23.589827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:23.590256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:23.723155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:23.731270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:23.732935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:23.734106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4fdf3ee4-13ce-46ad-bc5b-53cb78ec3050 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155986 Nov 24 18:20:23.734665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 335/668] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:24.136464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:24.137309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:24.144293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:24.144744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:24.145519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:24.145980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:24.175287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2f4af8b1-281f-4dc8-bf6e-d6e69660d8ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Nov 24 18:20:24.175837 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 334/669] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:24.752639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:24.753199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:24.759567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:24.760013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:24.760781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:24.761212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:24.972803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:24.980808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:24.982390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:24.983520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-268cc62f-1512-4451-bae6-ffa251410850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.235057 Nov 24 18:20:24.984066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 336/670] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:24 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:20:25.186701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:25.187635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:25.193848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:25.194291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:25.195063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:25.195482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:25.225151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4e80a141-bdaa-4da3-b921-0dec92e2105b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Nov 24 18:20:25.225704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 335/671] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:26.002081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:26.002700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:26.008947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:26.009387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:26.010172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:26.010599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:26.140359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:26.148627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:26.150151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:26.151304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-63c4a804-c8d6-4f11-8d09-f42b32f4ecfd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153594 Nov 24 18:20:26.151871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 337/672] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:25 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:26.236446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:26.237343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:26.243458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:26.243906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:26.244666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:26.245093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:26.273594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d4f347f-f022-4820-bf30-1307db9f730d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 Nov 24 18:20:26.274159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 336/673] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:27.170091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:27.170690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:27.177197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:27.177637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:27.178420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:27.178846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:27.285032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:27.285996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:27.292112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:27.292563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:27.293347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:27.293813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:27.305374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:27.314298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:27.315802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:27.316941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c61c1d57-7501-4da1-9d19-ae08112e134f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150511 Nov 24 18:20:27.317499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 338/674] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:27.324254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ccdb3a2-9713-4a48-852b-9484440a26c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 Nov 24 18:20:27.324798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 337/675] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:28.335459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:28.336069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:28.336224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:28.336984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:28.342626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:28.343009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:28.343464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:28.343629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:28.344240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:28.344421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:28.344674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:28.344923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:28.373238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-49cca884-5c10-40b1-b468-94acc20668ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040813 Nov 24 18:20:28.373812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 338/676] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:28.470673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:28.478992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:28.480517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:28.481655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77baeccb-762c-455a-ac8a-f77696653927 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149893 Nov 24 18:20:28.482249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 339/677] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:29.385336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:29.386185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:29.392882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:29.393320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:29.394119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:29.394546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:29.423228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4468fc35-85cb-417d-b467-aa1dedb30aea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Nov 24 18:20:29.423792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 339/678] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:29.490398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:20:29.490581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:20:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:20:29.498844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:29.499599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:29.506090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:29.506537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:29.507301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:29.507724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:29.637106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:29.645787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:29.647285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:29.648431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e72d9993-beea-4baa-a7b6-939f8f3d5a22 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153230 Nov 24 18:20:29.648991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 340/679] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:30.335930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:20:30.336159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:20:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:20:30.434914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:30.435827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:30.442723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:30.443166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:30.443955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:30.444384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:30.472272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3f0c433b-4d3e-4849-b618-88c8d70dd178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041035 Nov 24 18:20:30.472806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 340/680] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:30.667150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:30.667754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:30.675308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:30.675752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:30.676518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:30.676956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:30.808695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:30.817915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:30.819399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:30.820573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-40c0170c-2b91-462f-a435-a74949556009 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157109 Nov 24 18:20:30.821120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 341/681] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:31.484377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:31.485288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:31.491522 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:31.491970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:31.492743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:31.493179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:31.521195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-44c26997-6177-4171-95a7-632afec83a03 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 Nov 24 18:20:31.521743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 341/682] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:31.839957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:31.840593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:31.848174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:31.848638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:31.849379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:31.849835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:31.982528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:31.991693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:31.993185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:31.994357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cb975fa4-430a-4ff8-a60c-b2bc201fbea9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158124 Nov 24 18:20:31.994905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 342/683] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:32.533019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:32.533987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:32.540229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:32.540668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:32.541431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:32.541887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:32.570410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df637af4-7921-42c2-a14f-8c541092856a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041809 Nov 24 18:20:32.570960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 342/684] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:33.013703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:33.014522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:33.021442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:33.022000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:33.022844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:33.023344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:33.231433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:33.251181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:33.252700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:33.254043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9c51e86-e656-42fa-b219-4c2b7717d337 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.243921 Nov 24 18:20:33.254911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 343/685] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:33.581467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:33.582412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:33.588647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:33.589098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:33.589980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:33.590427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:33.620305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-97969ecc-3ed0-4077-a3b0-c3963af1e930 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Nov 24 18:20:33.620856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 343/686] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:34.272081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:34.272693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:34.278823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:34.279260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:34.280024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:34.280569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:34.413478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:34.422314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:34.423795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:34.425176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10c25951-c6a6-4fd9-9f76-6f3b63c8af08 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156702 Nov 24 18:20:34.425723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 344/687] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:34.631647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:34.638670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:34.638798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:34.639179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:34.640619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:34.641194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:34.670256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f2ac0bbf-683c-40fe-ac59-e2be081f668f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Nov 24 18:20:34.671552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 344/688] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:35.443553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:35.444184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:35.450403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:35.450844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:35.451599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:35.452023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:35.583257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:35.591425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:35.593075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:35.594346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4b96e077-f301-4f8e-8e9c-73b9780c9ab3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154454 Nov 24 18:20:35.594915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 345/689] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:35.682308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:35.683206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:35.690211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:35.690655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:35.691411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:35.691838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:35.720657 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5c8a49c1-f1f5-4f4a-ac37-cca60f6d2e7a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Nov 24 18:20:35.721209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 345/690] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:36.612893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:36.613505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:36.620054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:36.620446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:36.621222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:36.621656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:36.731197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:36.732124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:36.738990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:36.739430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:36.740207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:36.740637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:36.751264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:36.759496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:36.760988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:36.762162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5aba8aee-2f7b-4e8d-8d9c-0f9665db21ad tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153677 Nov 24 18:20:36.762721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 346/691] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:36 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:36.769960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f6043ec7-772b-4113-8f7a-f778a177deba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Nov 24 18:20:36.770520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 346/692] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:37.781430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:37.782052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:37.782423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:37.782523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:37.788682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:37.795125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:37.795266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:37.795369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:37.795470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:37.795553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:37.795633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:37.795725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:37.836847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-40204aa9-3bb7-4ae4-9522-3b5db3335463 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059733 Nov 24 18:20:37.837519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 347/693] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:37.991995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:38.004292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:38.006071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:38.007305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ff5c67c9-334f-4e97-b4c4-5590b34216c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.230187 Nov 24 18:20:38.008272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 347/694] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:38.950543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:38.951514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:38.957518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:38.958004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:38.958777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:38.959213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:38.989878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5b468ff3-08bd-46d6-be3c-16d045b5e206 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144411 Nov 24 18:20:38.990426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 348/695] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:39.026426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:39.027028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:39.033701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:39.034182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:39.034954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:39.035394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:39.160944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:39.168944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:39.170458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:39.171706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c7ea532a-423b-4da4-b742-5940c24ec097 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148885 Nov 24 18:20:39.172256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 348/696] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:39 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:40.001783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:40.002697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:40.008419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:40.008887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:40.009643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:40.010100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:40.037555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e533a019-b8c2-43d8-a6bb-413e65193725 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Nov 24 18:20:40.038136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 349/697] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:40.190866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:40.191476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:40.197388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:40.197874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:40.198653 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:40.199090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:40.328010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:40.336092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:40.337574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:40.338742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-90adbede-4c48-4be2-8607-fe0e28007556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152414 Nov 24 18:20:40.339275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 349/698] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:41.049106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:41.050307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:41.056490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:41.056946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:41.057717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:41.058177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:41.087358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2357a8d9-2c9e-49e0-94a7-7ce3c05cb1cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Nov 24 18:20:41.087905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 350/699] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:41.357180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:41.357799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:41.365875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:41.366463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:41.367775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:41.368517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:41.501671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:41.509837 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:41.511334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:41.512474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ad7efb81-e4ac-4193-93c1-897b42ec0566 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159002 Nov 24 18:20:41.513029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 350/700] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:42.098950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:42.099877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:42.106672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:42.107126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:42.107937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:42.108376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:42.139123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb3e8e2d-f77c-4d85-adcb-fbd9147c1037 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Nov 24 18:20:42.139689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 351/701] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:42.530264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:42.531576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:42.537686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:42.538161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:42.538922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:42.539348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:42.667447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:42.676472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:42.679597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:42.679597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ba95d2e-c80d-449f-bd91-3dd739f41850 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152659 Nov 24 18:20:42.680397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 351/702] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:43.150397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:43.151298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:43.158315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:43.158757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:43.159516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:43.159944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:43.188032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-24015129-bd9f-4722-a84c-a7d9cc0a37a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 Nov 24 18:20:43.188573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 352/703] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:43.697648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:43.698378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:43.705097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:43.705542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:43.706348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:43.706778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:43.841289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:43.850180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:43.851663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:43.852802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-47ffcf9d-a9be-4372-9eef-f933677d052e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158886 Nov 24 18:20:43.853359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 352/704] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:44.199379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:44.200286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:44.206693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:44.207137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:44.207902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:44.208328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:44.237491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2681fc63-f74f-4cbd-a53e-71b39adf051f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 Nov 24 18:20:44.238069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 353/705] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:44.870978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:44.871582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:44.878602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:44.879075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:44.879851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:44.880285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:45.008649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:45.017563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:45.019093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:45.020236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6e00364e-0ad8-4f47-b5d9-d27a8da1aa75 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152863 Nov 24 18:20:45.020795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 353/706] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:45.248766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:45.250318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:45.256615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:45.257009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:45.257797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:45.258238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:45.289353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f27669b-29d5-4e44-9ebb-c6df7c12057f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Nov 24 18:20:45.289922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 354/707] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:46.134671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:46.135267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:46.140959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:46.141400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:46.142186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:46.142617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:46.270259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:46.278299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:46.279794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:46.281469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7df9f779-5fdb-4c64-92f9-d642d9932f16 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.246760 Nov 24 18:20:46.282073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 354/708] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:46 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:46.301032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:46.301973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:46.308268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:46.308659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:46.309424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:46.309893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:46.337811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f758c3f2-f401-49be-8a67-d934b8a4a576 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Nov 24 18:20:46.338363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 355/709] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:47.300765 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:47.301394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:47.307691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:47.308142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:47.308917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:47.309347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:47.348364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:47.349289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:47.355499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:47.355951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:47.356734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:47.357172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:47.387062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6aefdc5e-7dc3-40de-9f32-857d6cfbb953 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Nov 24 18:20:47.388192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 356/710] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:47.441834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:47.450234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:47.451728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:47.453501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b69a16be-e866-4fb4-ae97-94417885b3af tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157472 Nov 24 18:20:47.454092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 355/711] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:48.399200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:48.400261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:48.406518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:48.406972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:48.407742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:48.408179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:48.438012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f8ea51b-fc4c-4d39-8ca0-ab56c8226186 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041580 Nov 24 18:20:48.438570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 357/712] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:48.471591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:48.472198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:48.478352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:48.478793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:48.479552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:48.479979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:48.609450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:48.618366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:48.619871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:48.621024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4b6619eb-9c0d-47c5-b903-9e90a021cd24 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153316 Nov 24 18:20:48.621582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 356/713] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:49.449652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:49.450586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:49.456926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:49.457365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:49.458151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:49.458577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:49.487531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e358461f-3331-46c6-acb4-b2262f6be088 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041665 Nov 24 18:20:49.488075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 358/714] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:49.639565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:49.640710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:49.646979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:49.647430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:49.648203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:49.648638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:49.781632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:49.789933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:49.791428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:49.792613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a20e5b89-c322-43d4-a2f7-1b0b0cbd5f46 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156695 Nov 24 18:20:49.793147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 357/715] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:50.498559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:50.499650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:50.506430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:50.506879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:50.507649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:50.508092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:50.536014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1c555e79-d808-4664-9659-4869f026af1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 Nov 24 18:20:50.536557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 359/716] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:50.810692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:50.811315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:50.817845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:50.818294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:50.819069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:50.819498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:50.946684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:50.955130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:50.956620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:50.957827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4a3e08ca-45fd-4422-bdde-6fc516d51d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150730 Nov 24 18:20:50.958386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 358/717] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:51.547412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:51.548461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:51.554994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:51.555446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:51.556220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:51.556651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:51.587225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b4030302-e9ca-4790-8c0e-7fd14bcc5991 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Nov 24 18:20:51.587775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 360/718] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:51.975705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:51.976313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:51.982535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:51.982984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:51.983756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:51.984754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:52.114240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:52.122309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:52.123803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:52.125654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4e77c516-15c5-4b95-a557-5b955f8269ed tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152872 Nov 24 18:20:52.126234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 359/719] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:52.598665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:52.599573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:52.605691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:52.606163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:52.606921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:52.607353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:52.636086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02ddfeaf-b051-4608-bd25-1dc0a0d25714 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041119 Nov 24 18:20:52.636622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 361/720] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:53.143887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:53.144438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:53.151497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:53.151942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:53.152707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:53.153138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:53.281555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:53.291828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:53.292098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:53.293254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6f72314-044b-4419-a76d-46fe2c5b224e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153150 Nov 24 18:20:53.293829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 360/721] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:53 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:53.647453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:53.648355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:53.654647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:53.655091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:53.655852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:53.656370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:53.685018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6d558fee-8cb6-48ed-9f02-852f293b0d55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Nov 24 18:20:53.685565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 362/722] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:54.312127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:54.313150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:54.318636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:54.319084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:54.319857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:54.320288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:54.454849 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:54.462946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:54.464444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:54.465594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-73311100-bfe5-4c33-bc17-fd7e07a13372 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157370 Nov 24 18:20:54.466213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 361/723] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:54.697023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:54.698016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:54.705293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:54.705745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:54.706560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:54.706996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:54.735644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-120ae71e-b0f4-428f-8d36-0970beac98fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042415 Nov 24 18:20:54.736521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 363/724] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:55.484048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:55.485460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:55.492041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:55.492485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:55.493259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:55.493697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:55.620942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:55.629237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:55.630760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:55.631915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a88edbaa-0c90-4b63-9f32-254bc0f1589c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151545 Nov 24 18:20:55.632471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 362/725] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:55.747290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:55.748239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:55.754672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:55.758679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:55.758679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:55.758679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:55.786092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bb236bc9-f74f-4a5f-a414-8fe5c75b70a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Nov 24 18:20:55.786639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 364/726] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:56.651017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:56.651535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:56.658054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:56.658495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:56.659254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:56.659683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:56.785385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:56.793948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:56.795421 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:56.796135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:56.796586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2a33416f-870a-4456-b1d1-3a46c3524edc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149251 Nov 24 18:20:56.797673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 363/727] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:56.797871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:56.804364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:56.804804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:56.805569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:56.806021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:56.833848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-00c3d297-ce40-44de-aa86-71d38487d3e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Nov 24 18:20:56.834393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 365/728] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:57.815774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:57.816291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:57.822461 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:57.822930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:57.823694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:57.824124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:57.844311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:57.845302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:57.851521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:57.851968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:57.852734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:57.853165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:57.883540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff63b8cb-af5d-4e09-91f7-8d30bc3f0fab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042948 Nov 24 18:20:57.884108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 366/729] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:20:57.955249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:57.963268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:57.964741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:57.965896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b76c4f60-3087-43d3-9ddc-88eca908be2b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154530 Nov 24 18:20:57.966477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 364/730] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:58.895022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:58.895870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:58.902190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:58.902642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:58.903420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:58.903855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:58.932179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f100264-001f-4245-81d0-0ef2636442e5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Nov 24 18:20:58.932727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 367/731] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:20:58.983407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:58.984010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:58.990880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:58.991327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:58.992101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:58.992538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:59.116756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:59.124853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:59.126380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:59.127521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7ad3c0ee-e589-42cd-b389-fd39680b9840 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.147848 Nov 24 18:20:59.128083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 365/732] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:20:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:20:59.943860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:59.944773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:20:59.950957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:59.951405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:59.952178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:20:59.952613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:20:59.981399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bdd26ba0-45d3-4d76-a442-23d232872b0b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 Nov 24 18:20:59.981974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 368/733] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:20:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:00.145523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:00.146092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:00.152300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:00.152752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:00.153526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:00.153999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:00.287700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:00.295831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:00.298060 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:00.299470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d0904097-3d43-4215-97aa-236ce43c7f19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157422 Nov 24 18:21:00.300024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 366/734] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:00.992346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:00.993304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:00.999542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:01.000678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:01.001455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:01.001930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:01.029751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6bc936ee-9a8d-4537-8052-925878ce5c8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Nov 24 18:21:01.030312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 369/735] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:01.317911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:01.318552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:01.326044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:01.326044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:01.326044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:01.326442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:01.458764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:01.466951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:01.469049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:01.470358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a5fe1de7-36a9-44a4-ae17-e15b7afdb7b2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156090 Nov 24 18:21:01.470914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 367/736] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:02.040452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:02.041375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:02.047899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:02.048342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:02.049400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:02.049865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:02.081548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-99230767-ee12-4d14-b678-7170d81cb880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Nov 24 18:21:02.082208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 370/737] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:02.488993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:02.489728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:02.496490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:02.496939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:02.501185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:02.501185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:02.628271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:02.636512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:02.638043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:02.639191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ef1c6cde-6f49-45ca-af02-2cad873f147c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153941 Nov 24 18:21:02.639741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 368/738] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:03.093051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:03.094589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:03.100802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:03.101266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:03.102070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:03.102511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:03.130956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c0fb3e1b-d815-4b92-b4bd-c8b16b8bfabf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Nov 24 18:21:03.131505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 371/739] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:03.657892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:03.658626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:03.665721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:03.666195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:03.666979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:03.667407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:03.797304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:03.806175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:03.807775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:03.809086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c4d5a0df-dbfc-420c-b0f0-40e93d57b726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155207 Nov 24 18:21:03.809715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 369/740] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:04.142354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:04.143301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:04.149557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:04.150034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:04.150814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:04.151253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:04.180469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83cc70cd-5cfc-4d8a-b336-ff3b481521b4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Nov 24 18:21:04.181031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 372/741] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:04.833916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:04.833916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:04.835359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:04.835815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:04.836604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:04.837043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:04.966762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:04.975533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:04.977001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:04.978164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-411df51d-3515-4605-be33-fd9d246ffbb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154309 Nov 24 18:21:04.978715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 370/742] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:05.192445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:05.193374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:05.199605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:05.200058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:05.200829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:05.201265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:05.229683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee1793f3-d364-4ada-a5a1-bd7ecb7e5411 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Nov 24 18:21:05.230256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 373/743] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:05.996216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:05.996818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:06.003364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:06.003810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:06.004585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:06.005023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:06.134487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:06.143130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:06.144603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:06.145743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9c65104d-0aa6-4e10-90f8-d281e7e42414 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153226 Nov 24 18:21:06.146315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 371/744] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:06.241671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:06.242621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:06.248768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:06.249216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:06.251105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:06.251560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:06.279841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7fd1c5c8-b373-4424-85ec-c45b9745fd08 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Nov 24 18:21:06.280385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 374/745] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:07.164971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:07.165579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:07.172477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:07.177406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:07.177406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:07.177406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:07.291620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:07.292527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:07.298820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:07.299526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:07.300294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:07.300723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:07.305236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:07.314010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:07.315584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:07.316859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ea24d77-25e1-4fb6-9d74-f496dae72723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155604 Nov 24 18:21:07.317484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 372/746] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:07.333196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9b3e996-7821-4c5d-8d0e-4d4aa4ab06c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Nov 24 18:21:07.333747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 375/747] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:08.334980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:08.335560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:08.342320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:08.344493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:08.344672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:08.345425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:08.345579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:08.345902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:08.352184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:08.352636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:08.353412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:08.353882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:08.383304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c5ab1ba0-82ee-4bf7-8b4b-3330f08d0da2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Nov 24 18:21:08.383876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 376/748] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:08.473677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:08.481697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:08.483207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:08.484345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-54254cb4-5d9e-4d67-ba12-bcbc3923f073 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153057 Nov 24 18:21:08.484907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 373/749] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:09.395020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:09.395847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:09.402047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:09.402500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:09.403269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:09.403706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:09.432349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-04221fac-d2a4-49a7-990f-81b5079689ef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Nov 24 18:21:09.432901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 377/750] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:09.502884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:09.503486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:09.513909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:09.514651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:09.515431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:09.516516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:09.643929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:09.652279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:09.653771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:09.654996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bf4e22bc-a2c8-4b7d-bd28-58ec248964cc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156400 Nov 24 18:21:09.655544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 374/751] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:10.444112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:10.445065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:10.451042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:10.451490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:10.452261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:10.452695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:10.481424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78556b9b-8f1d-45f6-92ef-e420a6c3e74f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Nov 24 18:21:10.482004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 378/752] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:10.674579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:10.675216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:10.681224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:10.681674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:10.682476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:10.682913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:10.819388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:10.827465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:10.829568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:10.830731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0c122709-3869-4828-9c6b-953a257e5c2f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.160745 Nov 24 18:21:10.831276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 375/753] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:11.494021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:11.494937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:11.501192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:11.501638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:11.502428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:11.502858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:11.532372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c32979d5-6706-4fe0-afd5-37b007464bb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042184 Nov 24 18:21:11.532923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 379/754] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:11.848999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:11.849712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:11.856124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:11.856572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:11.857355 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:11.857814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:11.987409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:11.995505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:11.997000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:11.998190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-97b2d4de-c33e-4fab-aa1f-29cccf6fd725 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152959 Nov 24 18:21:11.998756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 376/755] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:11 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:12.543716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:12.544624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:12.551624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:12.552076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:12.552851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:12.553286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:12.583532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e2366444-8f68-4b36-821b-67efdef81dac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Nov 24 18:21:12.584085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 380/756] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:13.016431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:13.017081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:13.023335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:13.023785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:13.024564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:13.025001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:13.151204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:13.159519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:13.161022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:13.162191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c4f3723e-de92-43f8-b3d4-2cd887fdf75b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149610 Nov 24 18:21:13.162751 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 377/757] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:13.595618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:13.596532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:13.603065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:13.603512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:13.604283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:13.604719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:13.632772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96f77ead-2923-4419-bc85-fa3a172a7da7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 Nov 24 18:21:13.633326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 381/758] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:14.180583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:14.181227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:14.188049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:14.188498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:14.189273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:14.189709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:14.322093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:14.331131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:14.332632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:14.333801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2239f1ce-c96a-499d-b00c-b1a09f9c5002 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156859 Nov 24 18:21:14.334368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 378/759] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:14.644179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:14.645093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:14.651303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:14.651756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:14.652535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:14.652972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:14.682712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a74d460-5588-4b64-9916-d6a808c114c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Nov 24 18:21:14.683270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 382/760] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:15.352014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:15.352706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:15.361215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:15.361652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:15.362361 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:15.362792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:15.493275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:15.502628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:15.504176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:15.505329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ad1f0499-f79c-4779-8a1a-15a5e2f4edff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157019 Nov 24 18:21:15.505901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 379/761] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:15.700770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:15.701681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:15.710483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:15.710934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:15.711709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:15.712144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:15.740773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7089dae1-4fa9-4d71-afb0-c46e33566200 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Nov 24 18:21:15.741340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 383/762] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:16.524037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:16.524643 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:16.530911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:16.531639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:16.532756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:16.533194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:16.666651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:16.675115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:16.676618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:16.677793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1802846b-e035-4e45-bb22-7974a30465a0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157391 Nov 24 18:21:16.678347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 380/763] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:16.752030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:16.752936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:16.759115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:16.759552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:16.760313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:16.760738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:16.790384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8334b16b-efca-4731-99fa-fcaf4d1501a7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042149 Nov 24 18:21:16.790925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 384/764] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:17.695971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:17.696574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:17.702851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:17.703414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:17.704194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:17.704633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:17.801781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:17.802698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:17.808758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:17.809201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:17.810001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:17.810437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:17.833466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:17.840082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e70d1c90-2849-4a2d-bb17-408b7d2a8741 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Nov 24 18:21:17.840650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 385/765] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:17.841559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:17.843070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:17.844255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-facd92f8-01c6-4d2b-a853-fa5aafc4f20c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152009 Nov 24 18:21:17.844785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 381/766] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:18.851759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:18.852621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:18.859157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:18.860236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:18.861013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:18.861448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:18.862214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:18.862810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:18.868861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:18.869301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:18.870185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:18.870614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:18.891102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-874209e1-d3e0-4da1-8aed-8641d7389874 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Nov 24 18:21:18.891658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 386/767] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:18.997366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:19.006066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:19.007539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:19.008664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-35879c17-6ad7-4486-9aa6-0fb3a3ec2560 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151049 Nov 24 18:21:19.009210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 382/768] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:19.902218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:19.903136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:19.909351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:19.909831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:19.910607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:19.911043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:19.940483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7a8e6a1c-d9c4-4de9-b0d3-2e5b8b5af1d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042034 Nov 24 18:21:19.941035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 387/769] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:20.027037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:20.027655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:20.034412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:20.034864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:20.035640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:20.036082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:20.168245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:20.177633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:20.179164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:20.180321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4d4c1200-5d55-46f9-852c-b20e699661e7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157030 Nov 24 18:21:20.180876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 383/770] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:20 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:20.951834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:20.952775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:20.959108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:20.959554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:20.960319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:20.960752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:20.989449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cfeb6864-ff7c-4f5e-92cd-a1b8a75517c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Nov 24 18:21:20.990030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 388/771] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:21.198267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:21.198706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:21.205504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:21.205914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:21.206682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:21.207107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:21.333135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:21.341220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:21.342756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:21.344013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d0e2ed02-ec2a-4a05-9db9-05f03febe816 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149362 Nov 24 18:21:21.344570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 384/772] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:22.001579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:22.002507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:22.008665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:22.009094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:22.009877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:22.010305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:22.038202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-978b3e22-134a-4e98-bc5e-233ee5d12373 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041154 Nov 24 18:21:22.038742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 389/773] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:22.362805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:22.363403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:22.369575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:22.370044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:22.370808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:22.371235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:22.722309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:22.730437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:22.731939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:22.733090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e8f51c2f-35e9-4136-9085-804f2efc3a74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.374781 Nov 24 18:21:22.733642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 385/774] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:22 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:23.049793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:23.050615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:23.056682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:23.057126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:23.057921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:23.058349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:23.087485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d76a95de-e9a5-4a73-83ec-fac073e365c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Nov 24 18:21:23.088093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 390/775] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:23.751599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:23.752329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:23.758535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:23.758981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:23.759759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:23.760195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:23.887990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:23.896632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:23.898141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:23.899313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e63ac5b1-4e00-433f-8482-e82f884cf764 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151913 Nov 24 18:21:23.899854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 386/776] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:24.099478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:24.100386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:24.106638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:24.107089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:24.107865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:24.108302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:24.136663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a1521d50-909e-42c2-acd8-5dd1a129e675 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Nov 24 18:21:24.137219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 391/777] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:24.917962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:24.918567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:24.925688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:24.926158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:24.926930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:24.927364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:25.051870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:25.060028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:25.061458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:25.063319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f65e841f-ec18-41bc-b198-267d31c758c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149070 Nov 24 18:21:25.063875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 387/778] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:24 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:25.148385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:25.149305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:25.155502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:25.155989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:25.156799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:25.157237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:25.185946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e4161ed3-f25a-4142-9497-a4f683d22571 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 Nov 24 18:21:25.186490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 392/779] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:26.081932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:26.082453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:26.088634 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:26.089073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:26.089855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:26.090287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:26.198127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:26.199159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:26.206246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:26.206698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:26.207476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:26.207916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:26.220465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:26.228564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:26.230104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:26.231260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-87a2d1cc-8245-4f62-b5ee-6673129d76c3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153691 Nov 24 18:21:26.231818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 388/780] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:26.236680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aba74da2-62ce-4635-86c8-2dd6811c7876 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Nov 24 18:21:26.237222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 393/781] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:27.247131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:27.248053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:27.248632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:27.249242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:27.254648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:27.255104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:27.255688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:27.255882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:27.256137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:27.256316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:27.256910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:27.257347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:27.285807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7618da47-5605-4510-8463-e47c8b8c04c7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042294 Nov 24 18:21:27.286625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 389/782] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:27.388793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.397062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.398574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.399690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-498e13fe-9179-4366-b65f-556d090d1747 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154658 Nov 24 18:21:27.400245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 394/783] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:28.297624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:28.298595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:28.305245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:28.305698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:28.306509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:28.306947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:28.335063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-32e09d3b-8b75-4cc4-9220-abc76f03b010 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Nov 24 18:21:28.335607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 390/784] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:28.417296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:28.417928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:28.425124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:28.425569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:28.426363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:28.426794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:28.557243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.566718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.568211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.569360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6e83742b-364a-41d9-9663-371fd51e41a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155754 Nov 24 18:21:28.569943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 395/785] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:29.346900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:29.347824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:29.354120 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:29.354577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:29.355350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:29.355788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:29.383840 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-63723608-f0bd-4fd7-9010-80bf2504934d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041335 Nov 24 18:21:29.384389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 391/786] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:29.587810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:29.588414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:29.595434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:29.595883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:29.596652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:29.597108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:29.732182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.740564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.742106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.743240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bedfca6a-bb90-4c5f-861f-fb9960f65fda tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159111 Nov 24 18:21:29.743802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 396/787] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:30.395250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:30.396193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:30.402509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:30.402964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:30.403744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:30.404178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:30.433205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8adfb3b0-6beb-4bd8-a318-080aeaa23406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Nov 24 18:21:30.433756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 392/788] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:30.761700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:30.762323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:30.768576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:30.769017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:30.769781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:30.770219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:30.896645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:30.904929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:30.907128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:30.908254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71cf1cb0-bbea-409c-b87d-941a8c0c97d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150278 Nov 24 18:21:30.908793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 397/789] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:31.444324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:31.445238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:31.451747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:31.452209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:31.453626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:31.454197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:31.483475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8b3fb32f-ce3a-47a7-b223-dde1ad3cc02a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Nov 24 18:21:31.484632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 393/790] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:31.926746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:31.927352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:31.933567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:31.934053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:31.934824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:31.935296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:32.062880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.070879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.072374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.073518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2d6cf883-1624-48e6-a4ba-8310410dafb7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150743 Nov 24 18:21:32.074120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 398/791] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:32.495540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:32.496459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:32.503510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:32.503964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:32.504736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:32.505201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:32.536045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7f684c3a-f3aa-4055-90eb-92714ae2d6f0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Nov 24 18:21:32.536834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 394/792] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:33.092489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:33.093123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:33.100230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:33.100679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:33.101453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:33.101922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:33.234649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.243302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.244857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.246041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-021198ed-e14f-48ee-925b-a3ed9f5f4bef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157431 Nov 24 18:21:33.246585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 399/793] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:33.547399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:33.548309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:33.556593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:33.557150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:33.558999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:33.558999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:33.591976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d09e732a-5828-4116-933d-57d94b0a99b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048353 Nov 24 18:21:33.592524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 395/794] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:34.264105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:34.264843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:34.271682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:34.272121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:34.272890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:34.273316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:34.406806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:34.416409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:34.418401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:34.419611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9094027a-bc99-4f10-83c9-4ba47fffedd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159359 Nov 24 18:21:34.420174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 400/795] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:34.603384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:34.604357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:34.611407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:34.611891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:34.612674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:34.613116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:34.643489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8de38422-ce6c-460c-be0c-198c4fba8ad7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Nov 24 18:21:34.644055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 396/796] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:35.438628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:35.440196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:35.446500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:35.446945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:35.447703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:35.448134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:35.583815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.594902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.594902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.594902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-44b8b543-007a-484d-af0b-174ca6283024 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159831 Nov 24 18:21:35.595326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 401/797] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:35.654858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:35.655763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:35.662742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:35.663214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:35.663986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:35.664415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:35.697462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c0e4abcb-aabe-4fa9-9efc-6887468eaba0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Nov 24 18:21:35.698059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 397/798] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:36.613347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:36.613984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:36.620385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:36.620973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:36.621738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:36.622194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:36.708857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:36.709770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:36.715907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:36.716348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:36.717111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:36.717539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:36.745825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-be52da45-9596-4239-a971-d5ca946a8f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040563 Nov 24 18:21:36.749363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 398/799] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:36.750177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.757772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.759271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.760410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08bc936b-7fb9-4213-9e4e-428505337c74 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151042 Nov 24 18:21:36.760963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 402/800] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:36 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:37.756968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:37.757930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:37.764040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:37.764491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:37.765263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:37.765701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:37.779526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:37.780137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:37.786908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:37.787389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:37.788170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:37.788710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:37.799713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-84e31330-7c06-4681-949c-80c0155e8f27 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Nov 24 18:21:37.800465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 399/801] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:37.924619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.935341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.936836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.938706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bafc831a-b426-4db4-b587-8eaff20f4ced tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.162332 Nov 24 18:21:37.939425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 403/802] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:38.811239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:38.812143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:38.818398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:38.818839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:38.819602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:38.820026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:38.848745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f537663f-4e01-4a10-bd7e-6263e5e64b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Nov 24 18:21:38.849313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 400/803] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:38.961320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:38.962028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:38.968666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:38.969115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:38.970914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:38.971349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:39.100794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:39.108874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:39.110421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:39.111562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cb493c90-63ec-480b-9293-7010533ccdfb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153982 Nov 24 18:21:39.112124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 404/804] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:39.860683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:39.861484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:39.868026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:39.868483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:39.869264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:39.869704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:39.898704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e85cc8c7-e2bc-4eef-9da5-3384af0d38b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Nov 24 18:21:39.899263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 401/805] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:40.130461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:40.131001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:40.136975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:40.137428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:40.138232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:40.138667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:40.264191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:40.272378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:40.273904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:40.275054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a94ad7ee-3299-4b35-856d-b0d732624ba4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149220 Nov 24 18:21:40.275614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 405/806] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:40.910598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:40.911505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:40.917356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:40.917822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:40.918585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:40.919016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:40.947242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b995f2b6-3378-4b98-afc8-019a093a97e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040906 Nov 24 18:21:40.947791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 402/807] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:41.293755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:41.294295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:41.300971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:41.301415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:41.302202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:41.302631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:41.432960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:41.441944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:41.443426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:41.444550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b62897de-87f5-4e7d-b132-ea50aff7d145 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154542 Nov 24 18:21:41.445105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 406/808] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:41.958634 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:41.959549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:41.965736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:41.966228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:41.967003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:41.967441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:41.996598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7ced5049-093d-43ae-832b-ef99a1c03178 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Nov 24 18:21:41.997142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 403/809] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:42.462959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:42.463553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:42.469686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:42.470152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:42.470908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:42.471337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:42.598737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:42.606867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:42.608338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:42.609651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6327b8b-a1cb-423c-b923-7b4ef4af7066 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150348 Nov 24 18:21:42.610249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 407/810] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:43.008033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:43.008933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:43.015130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:43.015571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:43.016418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:43.016848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:43.044454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-90ccd967-6c40-40f6-b288-2986ce3da250 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040271 Nov 24 18:21:43.045141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 404/811] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:43.634866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:43.635470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:43.641917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:43.642392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:43.643205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:43.643867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:43.792878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:43.801791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:43.803307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:43.804447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02eb9dae-aada-4c18-95fe-f68b6d602ce5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.180264 Nov 24 18:21:43.805003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 408/812] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:44.056413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:44.057333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:44.063585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:44.064035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:44.064811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:44.065247 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:44.095292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-37077463-94ff-4da8-846c-7e710a1320e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Nov 24 18:21:44.095850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 405/813] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:44.822431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:44.823086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:44.829369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:44.829851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:44.830628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:44.831063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:44.958791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:44.966867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:44.968377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:44.970213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-deaebbf2-81e2-4cdb-9faa-61cbc7bf75df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150777 Nov 24 18:21:44.970857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 409/814] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:45.106581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:45.107453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:45.113903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:45.114353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:45.115127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:45.115557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:45.144107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3476d701-a9ec-4624-9bed-a5d8ae807a82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041334 Nov 24 18:21:45.144644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 406/815] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:45.988213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:45.988811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:45.995094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:45.995537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:45.996295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:45.996745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:46.124486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:46.132966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:46.134483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:46.135647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d832815b-eb4b-49dc-9dc5-9605d369a16f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151177 Nov 24 18:21:46.136205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 410/816] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:46.155201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:46.156114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:46.162974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:46.163424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:46.164192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:46.164621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:46.193675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-60e549be-0b11-4b68-9453-88ef26cbe994 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Nov 24 18:21:46.194255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 407/817] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:47.154701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:47.155248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:47.161912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:47.162356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:47.163111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:47.163539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:47.204035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:47.205074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:47.211195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:47.211638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:47.212408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:47.212837 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:47.242491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c17403a4-5c30-4952-9ee7-77533558d780 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Nov 24 18:21:47.243050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 408/818] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:47.294643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:47.303689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:47.305163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:47.306331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cfa2b67b-bd15-4912-bd53-c31b8fde0bfc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155431 Nov 24 18:21:47.306881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 411/819] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:48.254284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:48.255336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:48.261566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:48.262038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:48.262802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:48.263227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:48.291407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-095286fe-623a-4dad-b57d-dfca372f005e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Nov 24 18:21:48.291961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 409/820] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:48.324139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:48.324746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:48.331051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:48.331498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:48.332359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:48.332795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:48.460361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:48.468451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:48.470606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:48.471742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-add31c5d-08f7-4489-bee5-294014984f27 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151204 Nov 24 18:21:48.472300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 412/821] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:49.303429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:49.304333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:49.310532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:49.310970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:49.311729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:49.312151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:49.342159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-48b5f160-3033-453f-9c58-7ab41ebf9a88 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Nov 24 18:21:49.342712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 410/822] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:49.490148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:49.490759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:49.496938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:49.497389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:49.498200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:49.498637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:49.630411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:49.638506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:49.639993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:49.641251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1e77fc53-791b-4721-a921-46a76f3142d1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154628 Nov 24 18:21:49.642023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 413/823] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:50.353897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:50.354806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:50.361042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:50.361488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:50.362276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:50.362703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:50.390440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2b783a16-7c0c-4561-94af-4aad8a692050 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040241 Nov 24 18:21:50.391503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 411/824] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:50.660223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:50.660865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:50.667172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:50.667619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:50.668390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:50.668825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:50.798566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:50.806860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:50.808355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:50.809523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8ed99b19-5b3f-4e92-9c07-a0509222a13c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153641 Nov 24 18:21:50.810124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 414/825] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:51.411427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:51.411427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:51.411427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:51.411427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:51.412238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:51.412507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:51.442922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b85e57f9-1595-4087-b6d8-921dcc98cd17 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Nov 24 18:21:51.443488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 412/826] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:51.828213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:51.829639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:51.835894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:51.836339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:51.837105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:51.837540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:51.965541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:51.974217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:51.975696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:51.976812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d5135f41-6d11-4d72-8f8d-eb52c2bedd4f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152360 Nov 24 18:21:51.977362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 415/827] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:52.454899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:52.455809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:52.462027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:52.462478 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:52.463256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:52.463688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:52.491791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cc6b646c-d13b-4f82-85b2-5a89dc1dfa2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Nov 24 18:21:52.492340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 413/828] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:52.995025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:52.995666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:53.002095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:53.002539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:53.003299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:53.003727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:53.137864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:53.146938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:53.148461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:53.149689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3aad6b1d-6eb6-475e-8420-47aeeaebb732 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158307 Nov 24 18:21:53.150281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 416/829] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:53.503413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:53.504325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:53.510550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:53.510995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:53.511769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:53.512201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:53.541306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ea8ccb54-c8a7-4a5b-8267-4d4d76264eb9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Nov 24 18:21:53.541878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 414/830] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:54.168440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:54.169042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:54.175467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:54.175911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:54.176668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:54.177094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:54.304968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:54.313135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:54.314754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:54.315877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a188f66f-2723-4022-926a-acea08a95994 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151061 Nov 24 18:21:54.316434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 417/831] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:54.552645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:54.553563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:54.560153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:54.560604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:54.561386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:54.561841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:54.592271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-331e171c-05d4-46a1-878f-58e0be89c4ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Nov 24 18:21:54.592827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 415/832] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:55.333930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:55.334545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:55.340674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:55.341112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:55.341894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:55.342320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:55.472035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:55.480167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:55.481687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:55.482863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-067df062-426c-4ff6-97a8-e5816a193431 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152601 Nov 24 18:21:55.483425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 418/833] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:55.604382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:55.605368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:55.611822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:55.612265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:55.613028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:55.613454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:55.642334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1f4f6547-a033-4092-a6f9-16ae982eb56f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Nov 24 18:21:55.642887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 416/834] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:56.501376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:56.502013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:56.508450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:56.508852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:56.509629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:56.510099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:56.635656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:56.644300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:56.645803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:56.646939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-617a1f02-2e78-4026-9a1e-913a73c58a3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149294 Nov 24 18:21:56.647495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 419/835] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:56.653467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:56.654403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:56.661377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:56.661842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:56.662601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:56.663026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:56.691510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ed6af9c-ca26-4740-9b29-f0bb08b92ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Nov 24 18:21:56.692055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 417/836] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:57.664789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:57.665406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:57.671541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:57.671982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:57.672741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:57.674041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:57.702810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:57.703826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:57.710256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:57.710704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:57.711487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:57.711922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:57.742764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8fe4871a-2e00-44a1-986c-a1d3d9172b34 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Nov 24 18:21:57.743577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 418/837] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:57.821419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:57.830242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:57.831797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:57.832921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-af44735f-e438-4653-ba53-c02d566f3d5f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.171793 Nov 24 18:21:57.833468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 420/838] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:58.754689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:58.755590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:58.761747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:58.762223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:58.762985 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:58.763413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:58.791766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-15924573-f404-4069-9f7e-3491ffc0afd5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 Nov 24 18:21:58.792321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 419/839] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:58.850933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:58.851542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:58.857683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:58.858167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:58.858967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:58.859407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:58.986948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:58.995006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:58.996501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:58.997636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5a394c19-0665-4836-bec2-4df78663fdb0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150358 Nov 24 18:21:58.998234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 421/840] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:59.803432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:59.804338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:21:59.810580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:59.811021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:59.811780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:21:59.812209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:21:59.841070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1e19277a-dbff-454c-8eb1-688676187521 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 Nov 24 18:21:59.841620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 420/841] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:21:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:00.016099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:00.016737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:00.023003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:00.023453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:00.024232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:00.024669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:00.150132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:00.158924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:00.160439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:00.161582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-06920950-9352-47c1-bf4f-067ee2a3ceb3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149129 Nov 24 18:22:00.162176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 422/842] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:00.852274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:00.853107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:00.859349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:00.859801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:00.861118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:00.861553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:00.890334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f2f2fbdb-fa42-4f77-9f20-88bdd54009e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Nov 24 18:22:00.890893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 421/843] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:01.180116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:01.180905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:01.187353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:01.187802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:01.189201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:01.189842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:01.318315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:01.326481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:01.327965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:01.329266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-43824c6a-93c5-464d-961c-01144ef6c726 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152766 Nov 24 18:22:01.330377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 423/844] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:01.901025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:01.901891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:01.908847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:01.909222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:01.910056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:01.910497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:01.939890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f9a77a32-f72f-4462-aeec-ef9defbe8a1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Nov 24 18:22:01.940459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 422/845] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:02.352360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:02.352995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:02.359201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:02.359646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:02.361041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:02.361487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:02.486850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:02.495019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:02.496525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:02.497669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-426d728c-9fa7-4339-bd84-cb75d28ea58f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148963 Nov 24 18:22:02.498263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 424/846] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:02.951351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:02.952269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:02.958551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:02.959005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:02.959784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:02.960217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:02.990189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3cc34cd1-b24f-4b1c-ae91-78a39df20452 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Nov 24 18:22:02.990763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 423/847] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:03.516305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:03.517157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:03.523445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:03.523895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:03.524680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:03.525116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:03.656830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:03.665780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:03.667285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:03.668433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1878d2e9-754f-4cf8-ab14-c41a1a32472b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155809 Nov 24 18:22:03.668994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 425/848] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:04.006882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:04.007796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:04.014207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:04.014658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:04.015436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:04.015872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:04.047305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ae896436-8939-468a-ac4c-da3d1b9d1c54 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Nov 24 18:22:04.048123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 424/849] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:04.689052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:04.690336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:04.696986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:04.697497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:04.698339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:04.698778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:04.828571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:04.837366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:04.838899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:04.840046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3843069b-f4b2-41f6-b274-45b77467e2f0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155767 Nov 24 18:22:04.840591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 426/850] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:05.059263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:05.060217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:05.067229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:05.067615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:05.068401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:05.069023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:05.099826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-45970244-a574-4bb5-9ebb-1ab32b480f94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Nov 24 18:22:05.100396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 425/851] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:05.857550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:05.858178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:05.864608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:05.865047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:05.865846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:05.866274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:05.998618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:06.007646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:06.013109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:06.013109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1fc96a3b-dea6-478c-aa88-56ed7495806e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156372 Nov 24 18:22:06.013109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 427/852] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:06.112050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:06.112891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:06.119126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:06.123123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:06.123123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:06.123123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:06.150068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4cd753b8-7a3d-43c2-a461-47b0a5fe0832 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042633 Nov 24 18:22:06.150622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 426/853] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:07.028403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:07.029016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:07.035890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:07.036343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:07.037119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:07.037557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:07.162049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:07.164049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:07.170590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:07.171139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:07.171822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:07.172175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:07.172616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:07.180661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:07.183913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:07.183913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9fe3f91-a418-486b-81e6-61018ef81e0e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159057 Nov 24 18:22:07.195976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 428/854] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:07.204615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8766eb69-f0ba-4354-9167-77a64171810b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Nov 24 18:22:07.205191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 427/855] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:08.202006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:08.202617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:08.209048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:08.209498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:08.210301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:08.210740 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:08.215623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:08.216523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:08.224638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:08.224638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:08.225223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:08.225666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:08.264266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6cb684e5-8e45-4bec-a442-5f607e5467bb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Nov 24 18:22:08.264266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 428/856] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:08.352306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:08.360845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:08.362414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:08.363559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-46d3cfcf-12ea-422a-920d-8739105efca9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.165189 Nov 24 18:22:08.364118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 429/857] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:09.268525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:09.269439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:09.275754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:09.276194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:09.276964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:09.277391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:09.308500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dd826705-997a-4f8a-beb5-496dc69f8d31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Nov 24 18:22:09.308500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 429/858] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:09.382595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:09.383193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:09.389287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:09.389730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:09.390529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:09.390968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:09.520147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:09.528478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:09.530019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:09.531193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1462363-ae25-4b84-a0ac-58ca30b9d0cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152208 Nov 24 18:22:09.531756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 430/859] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:10.319226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:10.319787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:10.325750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:10.326230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:10.327013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:10.327448 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:10.357669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-591c8774-ae97-49f6-a283-647b6bda7c97 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042422 Nov 24 18:22:10.358339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 430/860] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:10.551153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:10.551764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:10.557618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:10.558107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:10.558886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:10.559324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:10.687738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:10.695918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:10.697384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:10.698530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c213a9a-17f5-4819-aebf-e4b438cb7410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152373 Nov 24 18:22:10.699089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 431/861] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:11.368532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:11.369452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:11.375800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:11.376495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:11.377020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:11.377458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:11.408369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fd3e8015-4352-4441-a6a3-d4df91166473 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Nov 24 18:22:11.413201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 431/862] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:11.717993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:11.718600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:11.724820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:11.725289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:11.726086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:11.726517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:11.858074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:11.866482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:11.867981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:11.869117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee8c16d4-5906-4df9-91b2-e0b91ed4d7a2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155176 Nov 24 18:22:11.869671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 432/863] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:11 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:22:12.421438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:12.422383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:12.430074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:12.430529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:12.431314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:12.431778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:12.462629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-413cba74-59b6-48b1-9169-6dacbb3305d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Nov 24 18:22:12.463176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 432/864] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:12.888255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:12.888799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:12.895533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:12.895974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:12.896741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:12.897167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:13.022993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:13.030985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:13.032463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:13.033778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ebc9b691-ef1b-47c3-b8b2-1a768e1350d6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149167 Nov 24 18:22:13.034340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 433/865] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:13.474211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:13.475127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:13.481285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:13.481735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:13.482549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:13.482985 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:13.512402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9a260e99-78fe-49b8-ab85-c2fc72e5103c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Nov 24 18:22:13.512948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 433/866] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:14.052297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:14.052906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:14.059183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:14.059629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:14.060410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:14.060849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:14.191108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:14.199246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:14.200737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:14.202199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-53b1ce8f-6ef2-48d4-9af6-345334460b30 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153661 Nov 24 18:22:14.202763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 434/867] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:14.524147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:14.525061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:14.531212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:14.531662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:14.532570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:14.533015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:14.563526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-345b1f4e-feff-42c9-8b58-82f4ee6dab90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 Nov 24 18:22:14.564088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 434/868] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:15.219993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:15.220604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:15.227206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:15.227651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:15.228428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:15.228870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:15.360617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:15.369386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:15.370913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:15.372085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0194aa63-6a15-4302-84d3-ab2438f88526 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155728 Nov 24 18:22:15.372640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 435/869] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:15 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:15.574750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:15.579609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:15.583788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:15.584275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:15.585051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:15.585480 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:15.615444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-506d4057-7a14-4cf2-ab22-cc8a732c5856 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Nov 24 18:22:15.615992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 435/870] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:16.391007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:16.391691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:16.398448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:16.398891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:16.399643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:16.400069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:16.527797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:16.536080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:16.537579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:16.538762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4d25f3c1-a7b0-445e-bb84-b79dee73f8b8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151389 Nov 24 18:22:16.539324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 436/871] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:16.626884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:16.628389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:16.634584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:16.635038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:16.635941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:16.636368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:16.664958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ffda685e-02db-47a5-b906-66e1cae0f2c2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Nov 24 18:22:16.665503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 436/872] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:17.558300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:17.558905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:17.566383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:17.566830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:17.567604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:17.568036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:17.680345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:17.680345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:17.684115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:17.684571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:17.685364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:17.685900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:17.700410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:17.709573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:17.711109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:17.712278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-39ffddd4-28ea-4afe-a1c9-38c56f66eff4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.157736 Nov 24 18:22:17.712820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 437/873] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:17.717597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7cdfbdd8-b80a-4336-9a0b-56f6f36407e1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Nov 24 18:22:17.718254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 437/874] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:18.728780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:18.730285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:18.730797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:18.731460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:18.737257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:18.737981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:18.739009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:18.739126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:18.739523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:18.739815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:18.740312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:18.740750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:18.769362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b0f36b3f-e319-4d5b-8543-8b5c45cd373c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Nov 24 18:22:18.769957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 438/875] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:18.867307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:18.875369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:18.876854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:18.878451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cccf585e-f70a-4353-bf35-7dab5a502099 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151455 Nov 24 18:22:18.879008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 438/876] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:22:19.780178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:19.781086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:19.787266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:19.787704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:19.788467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:19.788896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:19.820919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-59c2d3d8-279d-40cd-a895-8dee28ed3ef0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Nov 24 18:22:19.821479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 439/877] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:19.896819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:19.897417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:19.903739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:19.904186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:19.904955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:19.905387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:20.035065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:20.043275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:20.044773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:20.045951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-48f488ce-2b60-418d-b748-26f43969b48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153204 Nov 24 18:22:20.046508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 439/878] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:19 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:20.831975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:20.832875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:20.839083 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:20.839529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:20.840290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:20.840717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:20.868543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-170b3daa-5028-40c9-be1a-bc8d2541d97d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Nov 24 18:22:20.869088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 440/879] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:21.065222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:21.065774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:21.071938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:21.072377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:21.073141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:21.073571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:21.199777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:21.208298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:21.209842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:21.211002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-069fa525-70e1-4094-9b79-aada440d7fcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149525 Nov 24 18:22:21.211552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 440/880] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:21.879957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:21.880900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:21.887261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:21.887720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:21.889120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:21.889566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:21.918622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bd314c12-7885-4d89-a414-422bbe64be57 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Nov 24 18:22:21.919176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 441/881] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:22.229487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:22.230110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:22.236598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:22.237063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:22.237781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:22.238211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:22.365915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:22.374002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:22.375503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:22.376641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-73e5f32a-f591-4f77-ae26-91fa856bd498 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150811 Nov 24 18:22:22.377722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 441/882] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:22 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:22.930475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:22.931421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:22.937659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:22.938148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:22.938926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:22.939362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:22.968499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-67b062bb-705a-464e-be96-9fc7cc026920 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Nov 24 18:22:22.969046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 442/883] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:23.394767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:23.395387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:23.401674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:23.402163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:23.402945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:23.403382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:23.529356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:23.537622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:23.539156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:23.540305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5036c2aa-ff5e-4214-aec0-a743abdf3443 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149305 Nov 24 18:22:23.540866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 442/884] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:23.979732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:23.980674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:23.986945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:23.987400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:23.988176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:23.988614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:24.018615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-17d371b1-fb45-48a1-a4a9-78b7a99d75aa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Nov 24 18:22:24.019174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 443/885] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:24.559366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:24.559977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:24.566291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:24.566746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:24.567524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:24.567961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:24.701732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:24.706871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:24.708400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:24.709544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cac3bb40-e38a-49bd-8773-c610972959e6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153917 Nov 24 18:22:24.710124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 443/886] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:24 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:22:25.029899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:25.030807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:25.037669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:25.038131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:25.038899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:25.039326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:25.068246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1858120d-d195-46c2-994d-33590411c774 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Nov 24 18:22:25.068802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 444/887] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:25.727673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:25.728274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:25.734824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:25.735320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:25.737642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:25.738108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:25.868961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:25.877709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:25.879292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:25.880442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7cc51718-c06c-44c1-848e-259b56d780ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156524 Nov 24 18:22:25.880997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 444/888] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:25 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:26.079414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:26.080365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:26.086625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:26.087092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:26.087848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:26.088272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:26.116874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a56dfd7b-6020-4024-8f0f-a99b022d05fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Nov 24 18:22:26.117405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 445/889] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:26.899170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:26.899707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:26.906011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:26.906464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:26.907237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:26.907674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:27.034124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:27.042526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:27.044035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:27.045184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1b0e1a6d-684d-4475-9115-9aa85c083a79 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149778 Nov 24 18:22:27.045934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 445/890] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:27.128753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:27.129681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:27.135839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:27.143341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:27.143341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:27.143341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:27.164996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d8c7dba9-4bb7-43b8-b9b7-b9cab1e9c155 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Nov 24 18:22:27.165534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 446/891] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:27.170283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:22:27.170445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:22:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:22:28.065014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:28.065667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:28.072020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:28.072415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:28.073187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:28.073621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:28.177054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:28.177994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:28.184426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:28.184864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:28.185637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:28.186088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:28.206299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:28.214523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:28.214846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d74d44c2-0988-4a6f-abe2-faeec679719e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Nov 24 18:22:28.215399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 447/892] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:28.216024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:28.217178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-41941a04-5ee6-4ccd-8ec2-9e8ef3f2b17e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156570 Nov 24 18:22:28.217722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 446/893] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:29.226403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:29.227307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:29.233500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:29.233987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:29.234757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:29.235188 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:29.235879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:29.236562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:29.242859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:29.243400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:29.244246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:29.244755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:29.265161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-abbbb334-a3d4-4603-87ce-8c110dab0c7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Nov 24 18:22:29.265728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 448/894] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:29.373339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:29.382276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:29.383777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:29.384916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c7bd6860-caa6-4679-b6ca-9bb9b585bc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152945 Nov 24 18:22:29.385470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 447/895] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:29 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:22:30.276239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:30.277139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:30.283886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:30.284349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:30.285110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:30.285539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:30.313333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ffd892fa-7992-4792-a3ed-d2a38912b8cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040775 Nov 24 18:22:30.313897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 449/896] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:30.403209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:30.404385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:30.411266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:30.411705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:30.412466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:30.412920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:30.489073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:22:30.489073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:22:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:22:30.540066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:30.548050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:30.550394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:30.551527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7257dffe-1f4d-4af2-bdd0-527071efd5eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151990 Nov 24 18:22:30.552090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 448/897] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:31.324333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:31.325251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:31.331590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:31.332043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:31.332823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:31.333259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:31.363301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1b47c14d-73d9-4f99-a78c-089269d7b788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042751 Nov 24 18:22:31.363863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 450/898] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:31.570474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:31.571083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:31.577548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:31.578044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:31.578830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:31.579266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:31.710855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:31.719134 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:31.720785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:31.722062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7cc91a0b-070f-46aa-bcf4-e6e939ace7f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155258 Nov 24 18:22:31.722617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 449/899] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:32.374573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:32.375477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:32.382468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:32.382910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:32.383669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:32.384103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:32.411425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-43fc09eb-142b-4cc2-8894-c1f56aeec24a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040607 Nov 24 18:22:32.411965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 451/900] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:32.740733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:32.741391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:32.747624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:32.748065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:32.748819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:32.749245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:32.878824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:32.886890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:32.888381 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:32.889521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d8adbacf-d8ae-4c8b-84d9-f9547f6e1514 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153436 Nov 24 18:22:32.890124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 450/901] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:32 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:33.422533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:33.423446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:33.429938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:33.430391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:33.431198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:33.431632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:33.461321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-98d37562-d9c1-4b3c-bfad-6919ab56ab47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042411 Nov 24 18:22:33.462002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 452/902] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:33.908763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:33.909495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:33.915747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:33.916202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:33.916979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:33.917419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:34.046360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:34.054898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:34.056401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:34.057591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7062a0be-229c-4e21-9967-bbbd9ce993f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153177 Nov 24 18:22:34.058184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 451/903] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:34.472837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:34.473680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:34.479857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:34.480311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:34.481085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:34.481526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:34.509609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f63681da-8a0f-4dec-b5af-f83c1df1bbe0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040729 Nov 24 18:22:34.510185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 453/904] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:35.076125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:35.076739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:35.083698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:35.084155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:35.084926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:35.085365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:35.215111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:35.223545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:35.225042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:35.226222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d604714-5d87-4b7e-bb15-a47743dc5a65 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153847 Nov 24 18:22:35.226780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 452/905] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:35.520875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:35.521822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:35.527979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:35.528430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:35.529200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:35.529637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:35.560891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d99106aa-70ba-4478-810b-5d5d07799488 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Nov 24 18:22:35.561504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 454/906] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:36.244102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:36.244706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:36.250835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:36.251285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:36.252616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:36.253060 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:36.391767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:36.400363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:36.401883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:36.403013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4f7f4540-b283-4e09-bfcd-91d5802c0c19 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.162545 Nov 24 18:22:36.403565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 453/907] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:36 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:36.574423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:36.575335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:36.582494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:36.582946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:36.583777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:36.584213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:36.612229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77a80ceb-eec5-4afe-96ff-8870a8b39398 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Nov 24 18:22:36.612785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 455/908] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:37.030148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:22:37.030394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:22:37.421560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:37.422232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:37.428793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:37.429245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:37.430037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:37.430473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:37.560661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:37.570254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:37.571743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:37.572886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6a6da3a0-91ca-4b08-b0a0-a5b364c64ee9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155097 Nov 24 18:22:37.573447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 454/909] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:37.623295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:37.624203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:37.631657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:37.632103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:37.632873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:37.633308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:37.662018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c0857a30-0bda-4056-bdc2-0b54b4ab35a6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Nov 24 18:22:37.662561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 456/910] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:38.591728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:38.592334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:38.598688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:38.599128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:38.599895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:38.600324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:38.672446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:38.673352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:38.680350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:38.680794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:38.681559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:38.682016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:38.710462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5c5ef40-f8af-49c5-a2a4-fc1e0abd8156 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Nov 24 18:22:38.711021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 457/911] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:38.730264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:38.739196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:38.740673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:38.741910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0c1e1e82-be02-411f-8db2-a5a6ec4caf15 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154886 Nov 24 18:22:38.742453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 455/912] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:39.722233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:39.723173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:39.729419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:39.729912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:39.730689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:39.731123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:39.759923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8c76571-bd58-4b5c-9920-9f3410e3b841 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Nov 24 18:22:39.760138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:39.760596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 458/913] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:39.760691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:39.766907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:39.768633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:39.769469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:39.769938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:39.904293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:39.913471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:39.915027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:39.916170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-83997076-2cf1-4cd0-bb1e-27edbc7d07cd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.159977 Nov 24 18:22:39.916725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 456/914] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:39 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:22:40.772136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:40.773119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:40.778953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:40.779400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:40.780165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:40.780600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:40.809282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8639effd-4918-499c-8086-27a5668140a8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Nov 24 18:22:40.809856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 459/915] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:40.934683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:40.935283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:40.941928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:40.942370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:40.943136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:40.943565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:41.068648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:41.076842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:41.078363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:41.079501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cf9e72d0-3670-4cd7-b5c0-e89e8741c48d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.148579 Nov 24 18:22:41.080669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 457/916] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:41.821536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:41.822476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:41.828742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:41.829191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:41.831161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:41.831600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:41.859743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-12ef8a62-4f12-4cb9-bac2-09143479e1bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 Nov 24 18:22:41.860288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 460/917] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:42.099968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:42.100494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:42.106694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:42.107133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:42.107890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:42.108318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:42.237687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:42.245732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:42.247228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:42.248359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ce90df0-c461-44ad-acd0-7994eed1e6d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152423 Nov 24 18:22:42.248904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 458/918] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:42.870827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:42.871734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:42.877941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:42.878385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:42.879150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:42.879576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:42.907504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-737aebd9-af47-49dc-afb0-6b052d85ad0a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040414 Nov 24 18:22:42.908785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 461/919] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:43.267031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:43.268346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:43.274496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:43.274934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:43.275691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:43.276121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:43.402145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:43.410125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:43.411636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:43.412762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6ed027d-a009-4756-a256-248618fa12a6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.149403 Nov 24 18:22:43.413310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 459/920] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:43 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:43.919431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:43.920346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:43.927666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:43.928118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:43.928902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:43.929597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:43.964407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3a4f7a19-e64b-4fc4-91c7-c9096241d5f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Nov 24 18:22:43.964972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 462/921] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:44.431218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:44.431971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:44.438255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:44.438705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:44.439670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:44.439952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:44.569123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:44.577263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:44.578771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:44.580467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4466e24a-7e77-4811-bf23-2cd977b1eca5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152369 Nov 24 18:22:44.581102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 460/922] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:44.974564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:44.975467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:44.981593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:44.982065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:44.982825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:44.983254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:45.011503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ebc8c8aa-5dd5-4a02-b30a-6ee3b29bcc5a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 Nov 24 18:22:45.012041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 463/923] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:45.599217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:45.599812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:45.606020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:45.606482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:45.607312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:45.607745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:45.750112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:45.758551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:45.760046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:45.761217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d0568690-f48a-4fce-a909-2c8e58cda0d9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.166145 Nov 24 18:22:45.761794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 461/924] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:46.023308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:46.024220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:46.030492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:46.030943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:46.031706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:46.032140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:46.060837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95fc7d4e-93c8-4475-8492-d42274156908 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Nov 24 18:22:46.061385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 464/925] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:46.779851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:46.780464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:46.786798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:46.787250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:46.788021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:46.788460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:46.917798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:46.926170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:46.927683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:46.928828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ec8d4731-267c-4cd6-b305-46f20102e14f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152617 Nov 24 18:22:46.929378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 462/926] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:46 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:47.072059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:47.073005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:47.079245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:47.079742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:47.081081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:47.081506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:47.109420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a3592878-0edd-43a8-9e67-1befb3575b2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 Nov 24 18:22:47.109994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 465/927] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:47.947488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:47.948089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:47.954351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:47.955530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:47.956451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:47.956892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:48.087463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:48.095505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:48.097114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:48.098338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c05d15d0-6037-42d1-89e7-543926d0f01a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154587 Nov 24 18:22:48.098893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 463/928] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:48.120152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:48.121071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:48.127787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:48.128232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:48.129000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:48.129433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:48.158122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ebf59263-e4f2-4304-997e-5f6327c8934b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Nov 24 18:22:48.158716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 466/929] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:49.116411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:49.116949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:49.123112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:49.123559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:49.124325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:49.124760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:49.169478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:49.170426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:49.177444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:49.178068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:49.179005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:49.179507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:49.209735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b6fb99ec-27c1-436b-bbb0-86b8b3ee2add tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Nov 24 18:22:49.210328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 467/930] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:49.253975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:49.262064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:49.263545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:49.264675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b2017016-2ee7-4912-a98d-1565e6be23a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151992 Nov 24 18:22:49.265225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 464/931] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:50.219864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:50.221310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:50.228241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:50.229031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:50.230393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:50.231179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:50.260194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a3ece634-45f3-44d2-9ee7-a8c658e32ffc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Nov 24 18:22:50.260736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 468/932] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:50.283944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:50.284665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:50.290848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:50.291295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:50.292067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:50.292502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:50.421297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:50.429874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:50.431367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:50.432507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c39b38bf-9c7e-4c9e-be07-ab26e90b82a1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152822 Nov 24 18:22:50.433064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 465/933] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:50 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:51.272090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:51.273002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:51.279190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:51.279642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:51.280419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:51.280855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:51.309686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ae583383-b5f8-4a08-988b-c17d14504359 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 Nov 24 18:22:51.310259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 469/934] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:51.450550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:51.451145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:51.458014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:51.458467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:51.459240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:51.459676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:51.741529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:51.741529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:51.741900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:51.741900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bd27cf52-5c86-451e-adee-583d12e9cd6f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.155206 Nov 24 18:22:51.741900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 466/935] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:52.321589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:52.322457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:52.328588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:52.329038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:52.329838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:52.330274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:52.358228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-813c445a-946b-46d3-9392-47ed8f2cdab9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040340 Nov 24 18:22:52.358786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 470/936] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:52.621439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:52.622001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:52.628291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:52.628732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:52.629498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:52.629961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:52.753946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:52.762892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:52.764359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:52.765482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-61b7dd3f-e7d3-4a9c-bec4-73790504986a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.147765 Nov 24 18:22:52.766090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 467/937] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:53.370196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:53.371116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:53.377905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:53.378558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:53.379266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:53.379702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:53.408073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a76c64dd-8aad-410d-8ee9-036a8e0bceaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 Nov 24 18:22:53.408699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 471/938] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:53.783759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:53.784454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:53.790608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:53.791054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:53.791815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:53.792249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:53.922426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:53.931519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:53.933000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:53.934223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-222558e7-9d7b-402f-bc28-4c5cdb9a30fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.154177 Nov 24 18:22:53.934744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 468/939] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:53 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:54.418591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:54.419496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:54.426496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:54.426944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:54.427714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:54.428154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:54.457680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-910aa590-da96-4d31-bc52-4c9709d2f2ae tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Nov 24 18:22:54.458262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 472/940] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:54.953064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:54.953681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:54.960538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:54.960989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:54.961782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:54.962219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:55.088220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:55.097005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:55.098553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:55.099707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a59d2004-1605-4a78-9f0f-7f017bfde5ab tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.150367 Nov 24 18:22:55.100262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 469/941] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:55.468953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:55.469892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:55.476061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:55.476506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:55.477268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:55.477696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:55.506429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a3d0c62b-4bf8-4a4a-83e6-62440bbe2f21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Nov 24 18:22:55.506975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 473/942] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:56.117854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:56.118465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:56.126288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:56.126734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:56.127694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:56.128137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:56.270377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:56.278419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:56.279893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:56.281025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-225a11ec-bc7f-472f-832a-59128004addf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.166811 Nov 24 18:22:56.281561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 470/943] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:56.516822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:56.517669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:56.524319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:56.524765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:56.525533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:56.525996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:56.556026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dfb95a3e-ba19-452f-bde7-c97913bd896a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Nov 24 18:22:56.556593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 474/944] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:57.299405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:57.300047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:57.306312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:57.306752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:57.307515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:57.307942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:57.437330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:57.446558 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:57.448043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:57.449175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b3d1abb7-d239-4ed4-b25c-7aaa3b6be61d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.153818 Nov 24 18:22:57.449723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 471/945] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:57 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:57.567222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:57.568142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:57.574459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:57.574953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:57.575722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:57.576160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:57.604497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d0f70c23-ae6e-4120-876a-212df33553c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Nov 24 18:22:57.605049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 475/946] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:58.467149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:58.467757 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:58.474270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:58.474717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:58.475493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:58.475927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:58.603037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:58.611246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:58.614011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:58.615171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ec8cf1b1-3913-4ccd-a695-c1b1674fc37e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.151639 Nov 24 18:22:58.615727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:58.616172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 472/947] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:22:58.616715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:58.622950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:58.623400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:58.624174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:58.624611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:58.652905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4906d952-079f-4385-8fb2-dfff74a3c1db tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 Nov 24 18:22:58.653452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 476/948] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:59.633787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:59.634395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:59.640674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:59.641124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:59.641931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:59.642371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:59.664324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:59.665348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:22:59.671630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:59.672075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:59.672850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:22:59.673541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:22:59.704052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c26ef790-44fb-40d5-b9b8-fce24480b237 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Nov 24 18:22:59.705026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 477/949] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:22:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:22:59.775801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:59.784147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:59.785620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:59.786793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dad77b0c-4a99-4855-8bcb-c98c9ecc6b47 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.156697 Nov 24 18:22:59.787348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 473/950] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:22:59 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:00.715435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:00.716353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:00.723493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:00.723943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:00.724725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:00.725165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:00.754434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7fefb69-ea1f-4029-9e33-21a4d5f2bf5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Nov 24 18:23:00.754997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 478/951] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:00.804799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:00.805444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:00.811947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:00.812340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:00.813116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:00.813550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:00.943069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:00.951109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:00.952591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:00.953721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-db49fa25-e598-430c-a514-b2148ad8dc36 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.152563 Nov 24 18:23:00.954287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 474/952] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:01.765265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:01.766215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:01.772694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:01.773146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:01.773967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:01.774408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:01.803791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bb7f3bb9-1628-4ad2-b6e9-ca3a6e5b9bc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042308 Nov 24 18:23:01.804341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 479/953] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:01.972941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:01.973550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:01.983953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:01.984408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:01.985183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:01.985611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:02.141184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:02.141184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:02.141549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:02.141549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c087c648-8266-4c8f-8997-0443bfefef48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1751 microversion: 2.20 time: 0.158629 Nov 24 18:23:02.141549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 475/954] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:02.815574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:02.816494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:02.822792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:02.823245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:02.824021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:02.824462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:02.853576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a32caf18-6fb8-45dd-bf8b-47e424b7ed52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Nov 24 18:23:02.854156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 480/955] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:03.145787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:03.146324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:03.152468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:03.152914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:03.153695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:03.154164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:03.283616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:03.292528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:03.294058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:03.295209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ad75404-61e6-4f98-b42e-3681ab911fae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153897 Nov 24 18:23:03.295756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 476/956] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:03.864449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:03.865279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:03.872597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:03.873050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:03.873852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:03.874293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:03.901980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-699edd14-5ba5-49dc-895c-07d4f3a373ba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041403 Nov 24 18:23:03.902528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 481/957] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:04.314099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:04.314699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:04.321139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:04.321578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:04.322365 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:04.322793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:04.453741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:04.462583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:04.464075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:04.465221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d819428-37cc-46a3-a6dc-1fd122cbb33d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.154785 Nov 24 18:23:04.465795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 477/958] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:04 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:04.912919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:04.913859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:04.920056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:04.920506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:04.921274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:04.921710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:04.951505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0debf8bf-5d2f-4077-83ee-9747ff530697 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Nov 24 18:23:04.952051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 482/959] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:05.483963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:05.484559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:05.491233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:05.491676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:05.492435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:05.492862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:05.623443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:05.641638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:05.643464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:05.644664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b449a17f-4d9b-438a-ab5c-fa4d90206410 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.164262 Nov 24 18:23:05.645191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 478/960] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:05.963861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:05.965545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:05.972004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:05.972481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:05.973990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:05.974451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:06.003520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-30ef378f-ea21-4213-82a7-fb8db4a347bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Nov 24 18:23:06.004006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 483/961] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:06.664617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:06.665831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:06.672057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:06.672534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:06.673575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:06.674041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:06.819791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:06.828100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:06.829576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:06.830744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9ca56481-de0a-481d-9bc6-9695372cd556 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.170441 Nov 24 18:23:06.831342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 479/962] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:06 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:07.015596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:07.016513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:07.023455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:07.028194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:07.028194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:07.028194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:07.053651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b37a537-3522-4060-927f-3c37795c2de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Nov 24 18:23:07.054262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 484/963] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:07.858881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:07.859598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:07.865719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:07.866830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:07.867792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:07.868231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:08.000144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:08.015409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:08.018391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:08.020553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ede573ac-1937-4ccc-be54-99b111af8f18 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.164981 Nov 24 18:23:08.021580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 480/964] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:08.064914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:08.065849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:08.072575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:08.073016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:08.073802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:08.074237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:08.102639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe6b5ad4-0f05-4165-9392-39c3d1157434 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041501 Nov 24 18:23:08.103111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 485/965] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:09.040498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:09.041102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:09.047322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:09.047771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:09.048809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:09.049253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:09.114094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:09.114927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:09.121868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:09.122322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:09.123105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:09.123547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:09.153252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2362f59c-c0c4-49c0-9805-5339815ffac8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 Nov 24 18:23:09.153815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 486/966] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:09.177407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:09.186066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:09.187600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:09.188747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c3be5da1-5140-47cc-9909-6325051d8bbd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152161 Nov 24 18:23:09.189295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 481/967] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:10.164473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:10.165378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:10.171720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:10.172173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:10.172945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:10.173647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:10.202144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f9d078a-6087-482f-ac86-544f9b56d3b8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041381 Nov 24 18:23:10.202706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 487/968] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:10.208334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:10.208929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:10.215310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:10.215751 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:10.216510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:10.216939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:10.344555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:10.352809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:10.354318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:10.355489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e0067382-6660-466b-933b-8c5a696f5ad7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150988 Nov 24 18:23:10.356031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 482/969] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:10 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:11.213189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:11.214121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:11.220263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:11.220707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:11.221463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:11.221919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:11.250244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-93a3236d-ac06-43d2-ba41-b5d6ff10339c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 Nov 24 18:23:11.250787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 488/970] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:11.373314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:11.373956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:11.380182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:11.380633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:11.381410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:11.382529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:11.511966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:11.520162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:11.521708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:11.523074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bcd1a363-6325-4283-8f34-82eab7ff09bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153324 Nov 24 18:23:11.523633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 483/971] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:11 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:12.261470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:12.262418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:12.268638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:12.269091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:12.269904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:12.270344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:12.300053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c68dee5-27a8-4117-8f14-ac4d11393bc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Nov 24 18:23:12.300602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 489/972] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:12.541048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:12.541572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:12.547842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:12.548559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:12.549329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:12.549786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:12.676232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:12.684778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:12.686285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:12.687416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-18f66650-ec49-4b28-822a-e420cfd051f3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150264 Nov 24 18:23:12.687967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 484/973] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:13.311386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:13.312296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:13.318576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:13.319029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:13.319803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:13.320243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:13.349692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a246fa15-c73a-42bf-b55d-aaf6ea8e4fbc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 Nov 24 18:23:13.350789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 490/974] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:13.705587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:13.706230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:13.713160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:13.713607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:13.714406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:13.714844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:13.846310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:13.854945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:13.856442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:13.857574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d618da6-42cf-483d-8815-2caeb296efcc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.155908 Nov 24 18:23:13.858158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 485/975] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:14.361629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:14.362488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:14.369182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:14.369634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:14.370465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:14.370903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:14.399412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08bfe185-667b-40be-92b2-b23c71ff8157 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Nov 24 18:23:14.399962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 491/976] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:14.876125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:14.876722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:14.883207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:14.883672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:14.884467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:14.884908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:15.012216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:15.020346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:15.021852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:15.024206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fd35f36b-a4b1-410b-921d-890f1475c144 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151743 Nov 24 18:23:15.024908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 486/977] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:14 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:15.410680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:15.411603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:15.418392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:15.418846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:15.419620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:15.420058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:15.449146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2b6a3f44-7b0e-4040-a81f-c2ff0b7281b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Nov 24 18:23:15.449710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 492/978] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:16.042490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:16.043104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:16.052707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:16.053575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:16.055030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:16.055828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:16.191632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:16.200703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:16.202255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:16.203407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-128b4db3-3e5a-4e10-810d-c5bda9085c1d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.164704 Nov 24 18:23:16.203959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 487/979] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:16 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:16.460811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:16.461633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:16.467870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:16.468312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:16.469070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:16.469501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:16.497621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a7e127c9-c7e7-4d57-96f2-8f590866ab22 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041092 Nov 24 18:23:16.498202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 493/980] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:17.221977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:17.222639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:17.229182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:17.229627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:17.230425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:17.230899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:17.357518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:17.365571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:17.367735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:17.368875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4feb9be7-7238-46e9-9c6c-876a9af716f8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150789 Nov 24 18:23:17.369424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 488/981] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:17 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:17.508802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:17.509704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:17.515874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:17.516313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:17.517064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:17.517488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:17.545566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0cbf1ef2-2dec-4746-91b0-ed8b2cc9276b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Nov 24 18:23:17.546132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 494/982] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:18.388906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:18.390081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:18.396788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:18.397366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:18.398253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:18.399003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:18.528397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:18.536557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:18.539129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:18.539925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cdaf8a24-dc67-4a46-89f8-afe1733ff50f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156735 Nov 24 18:23:18.540469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 489/983] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:18.556829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:18.557745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:18.564214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:18.564654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:18.565421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:18.565876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:18.594417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e2d30f3-261a-4c05-a847-29bf3c04b278 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041822 Nov 24 18:23:18.595213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 495/984] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:19.558925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:19.559326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:19.565396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:19.565889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:19.566678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:19.567116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:19.605601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:19.606721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:19.613043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:19.613572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:19.614473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:19.614984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:19.645159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-13ec944d-0ab8-49a1-9b71-fb71244c33d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Nov 24 18:23:19.645732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 496/985] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:19.695542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:19.703721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:19.705212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:19.706420 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b2d81cd4-a426-4153-942d-e7a61c67d0ba tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151545 Nov 24 18:23:19.706982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 490/986] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:19 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:20.656373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:20.657291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:20.664039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:20.664489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:20.665264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:20.665706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:20.694351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9b088097-306a-4255-9177-0bcab2c81d0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Nov 24 18:23:20.694908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 497/987] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:20.723864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:20.724465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:20.731350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:20.731796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:20.732603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:20.733097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:20.858587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:20.867408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:20.868911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:20.870098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ad0d0643-1a0c-4412-975b-306e043c059c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.149782 Nov 24 18:23:20.870680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 491/988] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:20 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:21.705632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:21.706591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:21.712775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:21.713201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:21.713989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:21.714415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:21.742745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-63951da4-5884-4a39-8a5b-c61b2c8786e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040868 Nov 24 18:23:21.743281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 498/989] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:21.888171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:21.888701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:21.894997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:21.895447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:21.896228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:21.896662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:22.028063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:22.036135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:22.038305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:22.039736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b2323384-625c-4de7-ac2d-d7c5a55d1b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.155302 Nov 24 18:23:22.040300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 492/990] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:21 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:22.753972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:22.754922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:22.762367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:22.762813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:22.763592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:22.764028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:22.791844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e7d97ab2-6a64-4575-bcc1-8d9b47e47531 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Nov 24 18:23:22.792396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 499/991] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:23.058770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:23.059317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:23.065344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:23.074535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:23.074535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:23.074535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:23.197498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:23.205565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:23.207065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:23.208226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-05450896-9a78-4fc6-9a0b-8d99a8c81c48 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153173 Nov 24 18:23:23.208778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 493/992] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:23 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:23.804896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:23.805863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:23.812053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:23.812531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:23.813300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:23.813737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:23.842425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb94fd90-3fe3-4a55-a48a-b2902a9d0083 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Nov 24 18:23:23.842970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 500/993] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:24.227210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:24.227815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:24.234068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:24.234519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:24.235294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:24.235732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:24.363345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:24.372153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:24.373646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:24.374852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4c517829-c14a-4823-8589-895aec59748c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152025 Nov 24 18:23:24.375404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 494/994] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:24 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:24.854475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:24.855308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:24.861526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:24.862019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:24.862799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:24.863237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:24.892252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d864b461-ce9a-46c0-beb8-1de49e3c3652 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Nov 24 18:23:24.892800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 501/995] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:25.393404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:25.394026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:25.400833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:25.401274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:25.402060 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:25.402489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:25.531244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:25.540221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:25.541698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:25.542865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f808c814-8272-46c2-8bc5-1f27697bc1ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153108 Nov 24 18:23:25.543563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 495/996] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:25 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:25.903520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:25.904346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:25.910631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:25.911072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:25.911838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:25.912265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:25.940685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff35fa34-1ff1-49cb-9b92-63e0912cb131 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Nov 24 18:23:25.941405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 502/997] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:26.559989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:26.560602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:26.567106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:26.567560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:26.568351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:26.569307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:26.701121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:26.710614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:26.711834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:26.713017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fefc8841-2a25-4e12-80cb-e2cb2f3104ea tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156702 Nov 24 18:23:26.713577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 496/998] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:26 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:26.952798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:26.953750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:26.960210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:26.960658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:26.961435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:26.961919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:26.990300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e2f94da-2c3b-45bd-bb87-dc381bd35bce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Nov 24 18:23:26.991417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 503/999] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:27.732066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:27.732668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:27.738658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:27.739102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:27.739867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:27.740299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:27.871440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:27.879497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:27.880974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:27.882255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-92b1cc9a-a3f3-4218-8df4-53d499f71333 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153893 Nov 24 18:23:27.882807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 497/1000] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:27 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:28.002038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:28.002987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:28.009317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:28.009787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:28.010565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:28.011004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:28.040029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-16d3bf24-b2be-4a57-9a42-35742e6d3d4d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Nov 24 18:23:28.040574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 504/1001] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:28.900503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:28.901113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:28.907346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:28.907795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:28.908569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:28.909027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:29.035133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:29.043789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:29.045321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:29.046628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8fb67c02-fbcb-4c89-9f53-8b54cd23dfd7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150017 Nov 24 18:23:29.047181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 498/1002] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:28 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:29.051526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:29.052430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:29.059381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:29.059877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:29.060592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:29.061027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:29.088591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb501b6b-3835-4133-89c6-f0792c5c1dc8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Nov 24 18:23:29.089136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 505/1003] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:30.065618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:30.066190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:30.072989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:30.073434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:30.074231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:30.074663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:30.099746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:30.100655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:30.106952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:30.107398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:30.108167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:30.108620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:30.144364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4bad73eb-d5d7-405d-9fc4-39051adde97e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048280 Nov 24 18:23:30.144935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 506/1004] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:30.212141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:30.220221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:30.221832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:30.222971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a867e7b7-b800-4466-9d6f-a55c572123dd tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.161181 Nov 24 18:23:30.223531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 499/1005] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:30 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:31.155888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:31.156753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:31.163112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:31.163562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:31.164330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:31.164770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:31.192754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c0f3e81-5ed4-4616-886c-b0184c4eb637 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040719 Nov 24 18:23:31.193302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 507/1006] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:31.241080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:31.241680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:31.247862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:31.248327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:31.249089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:31.249527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:31.377778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:31.386579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:31.388102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:31.389249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-db31ef6f-5f6d-4c9b-b95c-ca11e2b52026 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151785 Nov 24 18:23:31.389824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 500/1007] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:31 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:32.204437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:32.205362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:32.212249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:32.212700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:32.213473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:32.213951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:32.243645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cb0c8607-d1f7-47e6-a78f-50a33d41742f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Nov 24 18:23:32.244199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 508/1008] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:32.407879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:32.408490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:32.415360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:32.415807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:32.416579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:32.417013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:32.546681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:32.555167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:32.556664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:32.557829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fb04f180-af87-4c99-93f0-9304e05ff4c1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153737 Nov 24 18:23:32.558380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 501/1009] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:32 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:33.254950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:33.256069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:33.263042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:33.263491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:33.264262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:33.264892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:33.293928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8e728119-0d78-4114-9476-3baee71af1f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042727 Nov 24 18:23:33.294482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 509/1010] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:33.576136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:33.576805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:33.582999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:33.583446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:33.584958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:33.585271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:33.712430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:33.720525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:33.722055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:33.723205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dc596cf1-b84e-4cac-9049-7d7b2733b367 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150744 Nov 24 18:23:33.723770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 502/1011] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:33 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:34.306310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:34.307221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:34.313867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:34.314552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:34.315467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:34.315902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:34.344739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ad63d4c-a2e2-4c77-8f51-a31f1eea714e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Nov 24 18:23:34.345289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 510/1012] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:34.741618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:34.742264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:34.748587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:34.749029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:34.749828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:34.750266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:34.877217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:34.886106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:34.887586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:34.888708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f0ec431b-025d-433a-8f55-4c5d71eb7723 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150849 Nov 24 18:23:34.889246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 503/1013] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:34 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:35.356147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:35.356985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:35.363408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:35.363856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:35.364651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:35.365077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:35.394444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-89847afd-6e4c-4a5e-b26f-ae3cbbc2b5a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Nov 24 18:23:35.394992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 511/1014] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:35.908194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:35.908895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:35.915257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:35.915708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:35.916483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:35.916917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:36.054564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:36.058793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:36.060297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:36.061454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6df6ab6b-ad2c-4109-a31f-0b63b11509c9 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156958 Nov 24 18:23:36.062026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 504/1015] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:35 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:36.405595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:36.406520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:36.413341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:36.413724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:36.414508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:36.414937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:36.443216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2236f61d-e1af-4318-ad3b-51941427d3eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Nov 24 18:23:36.443760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 512/1016] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:37.080117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:37.080721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:37.087726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:37.088183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:37.088972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:37.089406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:37.231082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:37.243664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:37.243664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:37.244110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-36305d46-cb1a-4b38-b0d8-49aa975232ff tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.167606 Nov 24 18:23:37.244984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 505/1017] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:37 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:37.454435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:37.455350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:37.462122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:37.462572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:37.463336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:37.463771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:37.492176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-64d9d7b0-033e-40aa-a6d9-3f1b5d066018 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Nov 24 18:23:37.492728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 513/1018] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:38.263257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:38.264190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:38.270736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:38.271188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:38.272165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:38.272599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:38.405094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:38.414237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:38.415807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:38.417031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a582f692-2c89-4d17-9853-6954d0fd1706 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.157994 Nov 24 18:23:38.417658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 506/1019] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:38 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:38.503502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:38.504528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:38.511058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:38.511510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:38.512290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:38.512726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:38.542037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2eecd123-587f-47fb-b0d3-a0af7e9221f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Nov 24 18:23:38.542615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 514/1020] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:39.436151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:39.436688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:39.442855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:39.443301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:39.444583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:39.445011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:39.552711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:39.553623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:39.559935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:39.560383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:39.561159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:39.561584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:39.573915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:39.581951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:39.583419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:39.585188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c42e173c-d7c6-46e5-9b37-cd4d1aab5d9e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152818 Nov 24 18:23:39.585953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 507/1021] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:39 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:39.592024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-93631131-4376-44e3-bd4a-613b3dd27c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 Nov 24 18:23:39.592581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 515/1022] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:40.603798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:40.604417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:40.604792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:40.604902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:40.610403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:40.610567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:40.610841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:40.611046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:40.611600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:40.611815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:40.612034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:40.612246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:40.641358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-de32d34f-b9ad-4397-8e70-dd0a5bf856b5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Nov 24 18:23:40.641953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 508/1023] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:40.740346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:40.748498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:40.750155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:40.751303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4022ff7c-a38b-42d9-9b95-bb39764798a8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151773 Nov 24 18:23:40.751854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 516/1024] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:40 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:41.653538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:41.654532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:41.661046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:41.661499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:41.662336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:41.662983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:41.691523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-98088217-769e-4951-8e61-dadbec08bd64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Nov 24 18:23:41.692249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 509/1025] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:41.769242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:41.769879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:41.776903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:41.777351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:41.778157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:41.778593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:41.908482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:41.916758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:41.918288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:41.919416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f5a1b3f2-6047-4a86-8b75-752da15aa88d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153842 Nov 24 18:23:41.919974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 517/1026] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:41 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:42.703132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:42.704049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:42.710549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:42.710999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:42.711775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:42.712214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:42.740078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d1af0bea-833b-4e5c-a2a7-f131831f6de8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040654 Nov 24 18:23:42.741415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 510/1027] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:42.938411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:42.939016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:42.946324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:42.946777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:42.947549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:42.947987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:43.076485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:43.084687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:43.096038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:43.096038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9a3631c-9dd3-4a79-922c-bee3792a22fa tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152615 Nov 24 18:23:43.096038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 518/1028] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:42 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:43.752105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:43.753134 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:43.760273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:43.760723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:43.761501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:43.761965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:43.791319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d7f6a3a-92bb-4f88-b15f-8336ccd563a4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Nov 24 18:23:43.791881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 511/1029] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:44.113267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:44.113821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:44.120744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:44.121193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:44.121996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:44.122423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:44.251271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:44.259286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:44.260761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:44.261928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71ccf950-6349-47e7-98fd-ba26a9c20de5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152412 Nov 24 18:23:44.262477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 519/1030] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:44 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:44.803982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:44.804727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:44.811240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:44.811694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:44.812509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:44.812947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:44.841180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-58d98966-d71d-4ddf-8eec-c934e0b85f9d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Nov 24 18:23:44.841783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 512/1031] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:45.280974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:45.281572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:45.288868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:45.289315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:45.290109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:45.290542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:45.416898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:45.425214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:45.426739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:45.427909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b22ed2b8-f595-4f01-a385-bbf54b000276 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150599 Nov 24 18:23:45.428467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 520/1032] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:45 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:45.852992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:45.853844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:45.860021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:45.860473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:45.861252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:45.861687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:45.891736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1e99db5d-9692-4376-8a6a-f901e7e4c96f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Nov 24 18:23:45.892284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 513/1033] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:46.444912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:46.445523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:46.452025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:46.452499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:46.453291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:46.453721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:46.585036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:46.593631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:46.595174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:46.596341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1aac48dd-f91a-4ae3-ae6b-67d73cc61f39 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.155219 Nov 24 18:23:46.596896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 521/1034] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:46 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:46.903754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:46.904619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:46.912784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:46.913446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:46.914250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:46.914687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:46.943772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8f4d5fb5-f0cf-4b4e-980a-a98ebc3f3075 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Nov 24 18:23:46.944395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 514/1035] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:47.615764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:47.616342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:47.622719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:47.623160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:47.623926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:47.624351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:47.759109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:47.767263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:47.768780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:47.769952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2a7b6c00-524f-41ff-9b40-ffdd42cf5429 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.157866 Nov 24 18:23:47.770509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 522/1036] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:47 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:47.955074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:47.955978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:47.962484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:47.962924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:47.963689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:47.964143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:47.993734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dc9acaf6-85f5-48c9-b84c-8925c8552b7f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Nov 24 18:23:47.994285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 515/1037] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:48.788842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:48.789448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:48.795614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:48.796066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:48.796840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:48.797276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:48.922340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:48.932411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:48.933922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:48.935054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5c0079a2-c0e3-411e-a17d-1fba9afbacd0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150754 Nov 24 18:23:48.935596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 523/1038] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:48 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:49.004940 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:49.005871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:49.012146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:49.012589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:49.013360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:49.013814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:49.042914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-934202b8-65bd-4a7e-b342-6fca2e2aaed0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Nov 24 18:23:49.043451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 516/1039] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:49.507861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:23:49.508050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:23:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:23:49.953384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:49.953950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:49.960814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:49.961269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:49.962067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:49.962497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:50.055104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:50.056027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:50.062228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:50.062682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:50.063467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:50.063905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:50.092599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:50.092870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4eea8329-9226-4a0f-a5bc-49a626742d6d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Nov 24 18:23:50.093630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 517/1040] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:23:50.101428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:50.102948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:50.104071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-869ad5ba-cd3a-435f-8c97-ca807348fe12 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.154442 Nov 24 18:23:50.104604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 524/1041] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:49 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:50.352590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:23:50.352764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:23:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:23:51.104250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:51.105074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:51.111307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:51.111747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:51.112504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:51.112958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:51.122151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:51.122747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:51.128798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:51.129239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:51.130038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:51.130448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:51.142117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dcf519df-12a8-4517-a162-91bb5b5a57b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Nov 24 18:23:51.142670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 518/1042] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:51.258962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:51.267062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:51.268542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:51.269663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-29df20e1-d2b9-4d7e-8b28-a9a94a4031f4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151177 Nov 24 18:23:51.270245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 525/1043] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:51 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:23:52.153957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:52.154800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:52.160979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:52.161431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:52.162372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:52.162810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:52.191399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3ed8e074-5bc2-4e18-a9d0-99e0d8c5c7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041248 Nov 24 18:23:52.191938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 519/1044] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:52.288205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:52.288807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:52.294984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:52.295429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:52.296194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:52.296626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:52.424165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:52.433273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:52.434807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:52.435945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14ab3307-c16f-44a3-8f94-e3dbfda5f1c6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.152016 Nov 24 18:23:52.436493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 526/1045] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:52 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:53.203192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:53.204132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:53.210705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:53.211157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:53.211934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:53.212375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:53.241263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-82968dc1-c68d-4c61-8c21-7040cdede43d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041764 Nov 24 18:23:53.241826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 520/1046] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:53.454008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:53.454568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:53.461135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:53.461588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:53.462397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:53.462837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:53.592680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:53.601466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:53.603010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:53.604148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-786d51e5-f194-4b68-a48f-ab104b426d3f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.154004 Nov 24 18:23:53.604700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 527/1047] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:53 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:54.252060 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:54.252972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:54.259964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:54.260417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:54.261197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:54.261632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:54.289537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c31e293c-f55a-441e-9e83-b282af4d87ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 Nov 24 18:23:54.290106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 521/1048] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:54.622300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:54.622966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:54.629165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:54.629613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:54.630415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:54.631271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:54.762949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:54.771122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:54.773460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:54.774627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ac75de4-0a07-4272-b3fb-da5a4d62924e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156022 Nov 24 18:23:54.775176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 528/1049] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:54 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:55.300957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:55.301822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:55.307922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:55.308364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:55.309128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:55.309555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:55.338473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5c653485-f9b6-4fe7-8ae5-ac5f541d12e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Nov 24 18:23:55.339010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 522/1050] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:55.792102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:55.792706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:55.799337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:55.799782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:55.800544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:55.800976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:55.934101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:55.942260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:55.943916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:55.945055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dc3e696f-3893-4758-8603-29852623a24b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156777 Nov 24 18:23:55.945610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 529/1051] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:55 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:56.350240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:56.351292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:56.357476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:56.357951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:56.358738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:56.359165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:56.386859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3b1a36ee-f380-4b11-b43c-26f945077c67 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040965 Nov 24 18:23:56.387585 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 523/1052] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:56.963477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:56.964118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:56.970415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:56.970867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:56.971642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:56.972072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:57.104859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:57.113410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:57.114953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:57.116431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6a1cd31e-1404-4c11-ba60-890b58a14493 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156795 Nov 24 18:23:57.116986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 530/1053] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:56 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:57.398386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:57.399314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:57.405448 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:57.405923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:57.406683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:57.407113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:57.435629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bf5bbfb9-e2ab-49ff-9c6e-49dbd97fb175 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 Nov 24 18:23:57.436173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 524/1054] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:58.134226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:58.134830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:58.140943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:58.141375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:58.142339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:58.142768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:58.290025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:58.298421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:58.299895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:58.301029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1ad3f89-3cbe-4ad8-b8ec-b435e8d2bea1 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.171063 Nov 24 18:23:58.307493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 531/1055] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:58 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:58.447609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:58.448563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:58.455544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:58.455995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:58.456761 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:58.457218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:58.486397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-91816a09-33f6-482b-aeee-8ee0fd16b17f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Nov 24 18:23:58.486891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 525/1056] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:23:59.324018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:59.324627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:59.330863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:59.331315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:59.332084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:59.332521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:59.457414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:59.466353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:59.467852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:23:59.469002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ecc8a8f-8156-4539-a5d1-443ee0fc87ce tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.148705 Nov 24 18:23:59.469558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 532/1057] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:23:59 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:23:59.498031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:23:59.498944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:23:59.505268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:59.505714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:59.506636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:23:59.507059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:23:59.536187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3861ad64-0a83-40fb-8bc8-1e049fd82c69 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Nov 24 18:23:59.536739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 526/1058] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:23:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:00.487637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:00.488168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:00.494528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:00.494977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:00.495747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:00.496183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:00.548425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:00.549338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:00.556561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:00.558886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:00.559663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:00.560316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:00.593752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-098539d2-fe59-4267-8f85-7d0557bbfd14 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049360 Nov 24 18:24:00.594354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 527/1059] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:00.629446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:00.638523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:00.640065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:00.641212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-092bd03d-27e9-4921-9667-20fc2196fbb4 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.157314 Nov 24 18:24:00.641786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 533/1060] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:00 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:01.605846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:01.606760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:01.612960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:01.613442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:01.614380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:01.615013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:01.643793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-30e7232c-8446-4a2b-86b9-0ea36f6610b2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Nov 24 18:24:01.644352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 528/1061] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:01.659860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:01.660500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:01.667339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:01.667787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:01.668553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:01.668987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:01.800450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:01.808870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:01.810347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:01.811493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-84a43138-84ae-41e6-921e-a6d870089abc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.155314 Nov 24 18:24:01.812044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 534/1062] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:01 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:02.656039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:02.656939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:02.663392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:02.663834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:02.664601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:02.665025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:02.694951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0845b6f3-ba5f-4d42-9346-63f27727d048 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Nov 24 18:24:02.695508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 529/1063] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:02.830833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:02.832146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:02.839297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:02.839748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:02.845042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:02.845042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:02.974307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:02.982436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:02.983937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:02.985073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b78658df-7a5b-4902-8da1-2ddbf7859572 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.157987 Nov 24 18:24:02.985617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 535/1064] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:02 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:03.706351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:03.707284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:03.714645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:03.715100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:03.715954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:03.716413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:03.747052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e42098d7-16b4-45a6-8879-4655cf9c8064 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Nov 24 18:24:03.747607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 530/1065] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:04.003988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:04.004616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:04.010755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:04.011201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:04.011958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:04.012387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:04.141030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:04.149159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:04.150658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:04.151781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-729b7bb6-8055-4837-8456-44283b9bb2bc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.151479 Nov 24 18:24:04.152346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 536/1066] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:03 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:04.758575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:04.759551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:04.765916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:04.766370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:04.767160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:04.767594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:04.797451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a872e63e-af18-46e5-9627-4db479c72b8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Nov 24 18:24:04.798398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 531/1067] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:05.170732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:05.171347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:05.178474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:05.178920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:05.179686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:05.180162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:05.306529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:05.314606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:05.316095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:05.317226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-884c6b0f-3366-4ee5-8d9e-d6039c2ad0bb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.150254 Nov 24 18:24:05.317804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 537/1068] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:05 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:05.809327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:05.811842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:05.816504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:05.816999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:05.817831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:05.818802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:05.848772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a7b3ddc-0ee3-41dd-97c4-ba9b76848165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Nov 24 18:24:05.849396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 532/1069] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:06.337155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:06.337786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:06.344009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:06.344465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:06.345230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:06.345667 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:06.471350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:06.479876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:06.481373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:06.482554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6cb93f73-dbc2-415a-826f-dd6a92e04c0d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.149719 Nov 24 18:24:06.483114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 538/1070] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:06 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:06.860500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:06.861425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:06.868675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:06.869127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:06.869958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:06.870398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:06.900852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f58ad895-b9a0-4d46-9ed2-7b7f86bccb1d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Nov 24 18:24:06.901397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 533/1071] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:07.500237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:07.500847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:07.508092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.508542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.509338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.509795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.644245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:07.653455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:07.655337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:07.656486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-df6781f2-0e71-492a-9adc-58e8ed7dd671 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.159994 Nov 24 18:24:07.659291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:07.659960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:07.666173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.667210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.667477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 539/1072] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:07 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:07.668225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.668663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.884330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.objects.instance [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lazy-loading 'services' on Instance uuid 0d89cec0-16f4-478a-b48a-344063683dff {{(pid=116731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:24:07.912644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:07.914422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:07.919856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.920565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.921552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:07.922018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:07.961874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-62d87702-4a4e-41b3-a2ac-e4245ae8606f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053042 Nov 24 18:24:07.962793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 540/1073] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:08.188187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d827dc6-264d-4d1a-b03e-a250e27db6f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff/os-volume_attachments/b7af0bfd-8337-4967-bb8f-7b03ba5678fb" status: 202 len: 0 microversion: 2.1 time: 0.532525 Nov 24 18:24:08.188988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 534/1074] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:24:07 2021] DELETE /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff/os-volume_attachments/b7af0bfd-8337-4967-bb8f-7b03ba5678fb => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:24:08.674618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:08.675234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:08.681881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:08.682336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:08.683116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:08.683551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:08.813562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:08.821669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:08.823228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:08.824401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c3df1967-9da1-49a6-9015-5dc7250f2072 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.153645 Nov 24 18:24:08.824963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 541/1075] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:08 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:08.978269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:08.979339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:08.985321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:08.985784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:08.986560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:08.986986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:09.015481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5415497d-58a3-4e8a-a4ba-ac86cc4bb0c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Nov 24 18:24:09.016031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 535/1076] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:09.842079 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:09.842801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:09.848514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:09.848997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:09.849751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:09.850240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:09.982988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:09.992183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:09.993731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:09.994909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-22c29c0b-c6f0-42b6-bbff-19ef00fac26b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.156623 Nov 24 18:24:09.995456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 542/1077] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:09 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:24:10.026784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:10.027704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:10.034339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:10.034980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:10.035937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:10.036530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:10.068206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-335c0e45-8ad6-405d-9bec-284e2ed552c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Nov 24 18:24:10.068772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 536/1078] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:11.012499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:11.013167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:11.019379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:11.019830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:11.020607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:11.021042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:11.079639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:11.080561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:11.086871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:11.087325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:11.088113 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:11.088550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:11.128195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6c1c866d-8f17-4802-a5bc-d608d4833414 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052141 Nov 24 18:24:11.128761 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 537/1079] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:11.214439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:11.222596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:11.224001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:11.225140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b04b43f9-15a9-4774-a3b0-dd3fdba906df tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.216382 Nov 24 18:24:11.225822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 543/1080] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:11 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:12.140375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:12.141818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:12.150040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.150730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:12.151681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.152269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:12.186265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2771f2fb-4161-43f6-b348-67a561b99e9f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050040 Nov 24 18:24:12.186829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 538/1081] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:12.243614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:12.244387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:12.250768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.251313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:12.252102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.252539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:12.490720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:12.499783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:12.501554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:12.502817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95ef8a62-4f87-45f9-8fb7-f35ed24482f2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 200 len: 1745 microversion: 2.20 time: 0.263012 Nov 24 18:24:12.514118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 544/1082] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:12 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:12.581596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:12.582353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:12.590097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.590544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:12.591317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:12.591741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.193925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-36ca8259-46f2-440a-aa48-1eefb84f3371 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments/5a319c8e-8bd1-44d8-b2d3-957b6af8d006" status: 202 len: 0 microversion: 2.20 time: 0.615870 Nov 24 18:24:13.197266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 539/1083] 10.222.0.53 () {60 vars in 1456 bytes} [Wed Nov 24 18:24:12 2021] DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments/5a319c8e-8bd1-44d8-b2d3-957b6af8d006 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:24:13.198910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:13.205167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:13.205971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:13.206688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.207341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.207492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:13.208433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.209035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.216380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.216839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.218161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.218613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.241484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c3c9b502-deaa-4a32-b73e-2f59e1b6871a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047587 Nov 24 18:24:13.245743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 545/1084] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:13.253990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-207d546c-94e6-4bf5-a668-d97e226dcd81 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052613 Nov 24 18:24:13.254588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 540/1085] 10.222.0.53 () {60 vars in 1342 bytes} [Wed Nov 24 18:24:13 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:13.313149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:13.313650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:13.319944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.320907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.321868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:13.322306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:13.347782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:24:13.353999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.compute.api [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Working on deleting snapshot 145883de-5935-461a-a8a3-336376c64f71 from shelved instance... Nov 24 18:24:14.252267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:14.253188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:14.267395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:14.267847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:14.268635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:14.269066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:14.330114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-362f8ece-686e-4544-86d0-9ad8e3d0efda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076651 Nov 24 18:24:14.334847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 541/1086] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:15.001394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Doing local delete in cell 0c980a57-af87-4946-abcd-63304ecc43eb(cell1) {{(pid=116730) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 24 18:24:15.002325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:15.002842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:15.003343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.compute.api [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 24 18:24:15.029434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] deallocate_for_instance() {{(pid=116730) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 24 18:24:15.339371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:15.342463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:15.355997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:15.356456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:15.357261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:15.358703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:15.412605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9dacf01a-471f-458e-ad4d-2f70f323cf47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077679 Nov 24 18:24:15.412605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 542/1087] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:16.422159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:16.423529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:16.436952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:16.439438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:16.441126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:16.442660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:16.487572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d5d11a56-a39a-46bc-af3b-0e8faf3bd7e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069152 Nov 24 18:24:16.488814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 543/1088] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:17.137551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Updating instance_info_cache with network_info: [] {{(pid=116730) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 24 18:24:17.204878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-dd16c99f-7940-4967-8433-049a0d647440 req-321be38c-0805-47c3-bdd3-47cd10fa7959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837cce81-17da-4d50-ae72-0fa0765ffb36", "name": "network-vif-deleted", "tag": "644fba12-d45b-488a-b7aa-07835df6583b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:17.206451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:24:17.206451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:24:17.216553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-dd16c99f-7940-4967-8433-049a0d647440 req-321be38c-0805-47c3-bdd3-47cd10fa7959 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:17.221447 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-dd16c99f-7940-4967-8433-049a0d647440 req-321be38c-0805-47c3-bdd3-47cd10fa7959 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:17.228575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.compute.server_external_events [req-dd16c99f-7940-4967-8433-049a0d647440 req-321be38c-0805-47c3-bdd3-47cd10fa7959 service nova] Unable to find a host for instance 837cce81-17da-4d50-ae72-0fa0765ffb36. Dropping event network-vif-deleted {{(pid=116731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 18:24:17.229469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-dd16c99f-7940-4967-8433-049a0d647440 req-321be38c-0805-47c3-bdd3-47cd10fa7959 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.197199 Nov 24 18:24:17.230088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 544/1089] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 198 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 24 18:24:17.500056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:17.502718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:17.510979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:17.512018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:17.513674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:17.514384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:17.548549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fc31e01c-f4f9-44b3-a1aa-cab6346d95e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052596 Nov 24 18:24:17.549876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 545/1090] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:17.892978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.scheduler.client.report [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Deleted allocations for instance 837cce81-17da-4d50-ae72-0fa0765ffb36 Nov 24 18:24:18.561896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:18.566668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:18.571864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27558138-7aef-4786-bc32-0a1641562b5c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 204 len: 0 microversion: 2.20 time: 5.234210 Nov 24 18:24:18.572561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 546/1091] 10.222.0.53 () {60 vars in 1279 bytes} [Wed Nov 24 18:24:13 2021] DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 0 bytes in 5264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:24:18.588797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:18.589244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:18.589877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:18.590073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:18.594183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:18.594770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:18.598208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:18.599971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:18.601018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:18.602899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:18.625638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. Nov 24 18:24:18.626172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:24:18.627014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0da2532f-c46e-4625-8d7a-a587a7acb1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 404 len: 111 microversion: 2.20 time: 0.045810 Nov 24 18:24:18.631194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 547/1092] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:18 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 18:24:18.637576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-55935d1e-c7a7-448c-9d5f-abd6c27cdc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '.version_select at 0x7f8ba84709d0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:18.670291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cf8e8e1f-b16c-4ae1-8509-1355d3fe75b7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113061 Nov 24 18:24:18.673107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 546/1093] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:18.746560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-55935d1e-c7a7-448c-9d5f-abd6c27cdc00 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-548127892" status: 204 len: 0 microversion: 2.20 time: 0.114042 Nov 24 18:24:18.747350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 548/1094] 10.222.0.53 () {60 vars in 1258 bytes} [Wed Nov 24 18:24:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-548127892 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:24:19.685630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:19.685630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:19.694303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:19.695208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:19.704253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:19.705156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:19.747116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e9434a54-e5e8-4d23-a67f-b8b255a04faa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066847 Nov 24 18:24:19.748725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 547/1095] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:19.919686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'create', calling method: .version_select at 0x7f8ba84b2310>, body: {"keypair": {"name": "tempest-keypair-2105410190"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:19.942294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:24:19.946503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:24:20.303720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:24:20.310171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:24:20.332885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4570efd2-c459-444b-b0c0-f742d65ab0c8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.418955 Nov 24 18:24:20.334550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 549/1096] 10.222.0.53 () {62 vars in 1198 bytes} [Wed Nov 24 18:24:19 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:24:20.764367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:20.765297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:20.783820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:20.784460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:20.785369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:20.785945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:20.832951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8022e43c-e9c5-49c6-83b8-9adf62c231ee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071965 Nov 24 18:24:20.834018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 548/1097] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:21.850178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:21.854375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:21.860133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:21.860795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:21.862782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:21.872664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:21.930967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb3e2931-f3b8-4be3-8501-837e35158dd9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087815 Nov 24 18:24:21.931677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 550/1098] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:22.941993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:22.943576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:22.951930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:22.952299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:22.953503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:22.953962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:22.986077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cc73380f-f7fd-4602-b007-5a66f99f2d37 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047921 Nov 24 18:24:22.986642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 549/1099] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:23.134172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2110266390", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8570c77c-6fb6-4161-82b1-39ff9ba5d8f0"}], "security_groups": [{"name": "tempest-securitygroup--833637068"}], "key_name": "tempest-keypair-2105410190", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:23.304162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] validate_networks() for [('8570c77c-6fb6-4161-82b1-39ff9ba5d8f0', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:24:23.996164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:24:23.996691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:24:23.997156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:24:23.997444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:24:23.998004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:24:24.004116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:24.008015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:24.013633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:24.014124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:24.014940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:24.015377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:24.016168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:24.017035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:24.018041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:24.018709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:24.065912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for project f199730bd61b4b36b03f26cd2239415a. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:24:24.068425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c0d93a01-d0ba-417e-8d9e-0eab0194f399 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074193 Nov 24 18:24:24.073586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Getting quotas for user c08081398b694e24b07c10987ceefaad and project f199730bd61b4b36b03f26cd2239415a. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:24:24.078132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 550/1100] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:24.086484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:24:24.089515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:24:24.254463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9e6cc20c-3ddd-472c-b1fa-64126316b5c5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.125517 Nov 24 18:24:24.255960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 551/1101] 10.222.0.53 () {62 vars in 1187 bytes} [Wed Nov 24 18:24:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 18:24:24.266364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:24.267629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:24.373322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:24.384864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:24.388772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:24.389961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-27f7c6f1-12ad-44e7-ac3c-f9d761503322 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1282 microversion: 2.20 time: 0.127517 Nov 24 18:24:24.390517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 551/1102] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:24 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:24.967381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Action: 'create', calling method: .version_select at 0x7f8ba847eee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2118389392"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:24.984429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Getting quotas for project 6c252e140b6a444aa1ddfa98f1f789c6. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:24:24.988097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Getting quotas for user fa4f403110734716ad674cd15d880274 and project 6c252e140b6a444aa1ddfa98f1f789c6. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:24:25.079774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:25.080619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:25.088911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:25.089361 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:25.090174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:25.090604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:25.119959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8c54b901-27da-4be1-a561-23d77e384f52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Nov 24 18:24:25.120518 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 552/1103] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:25.146894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Getting quotas for project 6c252e140b6a444aa1ddfa98f1f789c6. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:24:25.151209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Getting quotas for user fa4f403110734716ad674cd15d880274 and project 6c252e140b6a444aa1ddfa98f1f789c6. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:24:25.163963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ce43292-e5b3-4802-a59e-f2cb7e25ed13 tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.357093 Nov 24 18:24:25.164566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 552/1104] 10.222.0.53 () {60 vars in 1157 bytes} [Wed Nov 24 18:24:24 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:25.408457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:25.409174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:25.415593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:25.416131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:25.416995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:25.417562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:25.486649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:25.502638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:25.505825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:25.508337 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a6c5b388-35e1-4095-903b-a59229137b92 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1286 microversion: 2.20 time: 0.102871 Nov 24 18:24:25.509786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 553/1105] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:25 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:26.131892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:26.132944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:26.138862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:26.139302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:26.140266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:26.140700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:26.173699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c28d6bed-5eff-4100-a264-86d8438b3466 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Nov 24 18:24:26.175141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 553/1106] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:26.527249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:26.527878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:26.534388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:26.535135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:26.535822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:26.536455 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:26.610973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:26.623075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:26.624826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:26.626254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b142f8b8-1d83-4c4b-95e4-812bab41c2d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1334 microversion: 2.20 time: 0.103539 Nov 24 18:24:26.627400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 554/1107] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:26 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:27.187396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:27.188743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:27.196832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:27.200529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:27.200529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:27.200529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:27.236360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a247a8d7-fa5b-4890-b090-eb4eaa9fef85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053602 Nov 24 18:24:27.237404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 554/1108] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:27.649609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:27.651993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:27.658939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:27.659562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:27.660842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:27.661387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:27.918909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:27.934686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:27.938482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:27.941227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1cc83186-28d2-4da1-bf7d-9b3d09395fd3 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.297101 Nov 24 18:24:27.942572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 555/1109] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:27 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:28.248680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:28.249609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:28.262408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:28.262943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:28.264152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:28.264597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:28.303194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-24f6014f-e072-441d-9914-4484a231187b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059323 Nov 24 18:24:28.305058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 555/1110] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:28.680216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-a2e5204d-fc19-4f40-9637-408fcf6b9d56 req-7aef2245-4fb6-4f2e-a360-d16553d5fee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f647ca-2f72-4260-93ad-0b9e49ec7d16", "tag": "906d31e1-a29f-435d-ab11-d57c4a281fa9"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:28.682519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:24:28.682519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:24:28.692831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-a2e5204d-fc19-4f40-9637-408fcf6b9d56 req-7aef2245-4fb6-4f2e-a360-d16553d5fee0 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:28.693271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-a2e5204d-fc19-4f40-9637-408fcf6b9d56 req-7aef2245-4fb6-4f2e-a360-d16553d5fee0 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:28.705338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-a2e5204d-fc19-4f40-9637-408fcf6b9d56 req-7aef2245-4fb6-4f2e-a360-d16553d5fee0 service nova] Creating event network-changed:906d31e1-a29f-435d-ab11-d57c4a281fa9 for instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 on hv-cinder-80403 Nov 24 18:24:28.710773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-a2e5204d-fc19-4f40-9637-408fcf6b9d56 req-7aef2245-4fb6-4f2e-a360-d16553d5fee0 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036272 Nov 24 18:24:28.711407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 556/1111] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:24:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:28.960035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:28.960960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:28.966387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:28.966905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:28.967676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:28.968108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:29.209888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:29.216028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:29.217711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:29.219003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0e1ebaee-7b61-4f20-baec-19f420c8de5b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.262661 Nov 24 18:24:29.219627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 556/1112] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:28 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:24:29.316008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:29.318643 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:29.325142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:29.325629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:29.326522 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:29.327042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:29.359998 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-856cee98-c924-482d-af4e-5c77fa3fc94e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Nov 24 18:24:29.360898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 557/1113] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:30.238249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:30.238851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:30.250650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:30.251178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:30.252071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:30.252577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:30.372891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:30.373865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:30.380198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:30.380651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:30.381431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:30.381906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:30.394811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:30.405070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:30.406645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:30.407744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe399e14-a724-479c-9414-5923836f7c67 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.173211 Nov 24 18:24:30.408283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 557/1114] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:30 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:24:30.428336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5da35e44-6735-4003-b254-46052ae014a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059175 Nov 24 18:24:30.428927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 558/1115] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:31.426969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:31.427571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:31.434410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:31.436854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:31.436854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:31.436854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:31.440986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:31.441945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:31.448963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:31.449467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:31.450460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:31.450899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:31.484310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cdd99a73-92b0-45f4-9dce-cc23c3d5cc63 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Nov 24 18:24:31.484882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 559/1116] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:31.573017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:31.580802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:31.582355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:31.583451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fce28399-e929-44af-a610-d3db048b8139 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.160238 Nov 24 18:24:31.584000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 558/1117] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:31 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:32.496638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:32.497486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:32.503874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:32.504314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:32.505073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:32.505506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:32.535024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bf4194af-6ea2-4c90-a9eb-506f30e35aec tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042800 Nov 24 18:24:32.535574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 560/1118] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:32.602165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:32.602824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:32.609106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:32.609559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:32.610359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:32.610797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:32.746337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:32.754882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:32.756337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:32.758328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-29f173e7-ac00-4025-9bbc-da59664986d7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.159980 Nov 24 18:24:32.759265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 559/1119] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:32 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:33.547145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:33.548351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:33.555289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:33.555932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:33.556721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:33.557194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:33.588182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f6b79097-78c0-463a-88c6-57b58a8d42f5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Nov 24 18:24:33.588739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 561/1120] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:33.779714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:33.779714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:33.784339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:33.784841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:33.785614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:33.786190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:33.923029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:33.931213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:33.932714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:33.933820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d56516a0-33a4-4e83-a6d2-e6a2dc6ffd34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.161258 Nov 24 18:24:33.934374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 560/1121] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:33 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:34.599649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:34.600598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:34.607293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:34.607743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:34.608542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:34.608980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:34.638618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dda262b0-d0cb-4868-b8c3-e363c5244fea tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Nov 24 18:24:34.639182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 562/1122] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:34.953324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:34.954076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:34.960419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:34.960910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:34.961694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:34.963320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:35.037108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-3828a4e7-3dcd-43b6-bb43-439840a17195 req-0fa62679-c34a-4407-81b3-dabf804e3517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f647ca-2f72-4260-93ad-0b9e49ec7d16", "name": "network-vif-plugged", "status": "completed", "tag": "906d31e1-a29f-435d-ab11-d57c4a281fa9"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:35.039039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:24:35.039039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:24:35.046668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-3828a4e7-3dcd-43b6-bb43-439840a17195 req-0fa62679-c34a-4407-81b3-dabf804e3517 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:35.046783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-3828a4e7-3dcd-43b6-bb43-439840a17195 req-0fa62679-c34a-4407-81b3-dabf804e3517 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:35.058228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-3828a4e7-3dcd-43b6-bb43-439840a17195 req-0fa62679-c34a-4407-81b3-dabf804e3517 service nova] Creating event network-vif-plugged:906d31e1-a29f-435d-ab11-d57c4a281fa9 for instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 on hv-cinder-80403 Nov 24 18:24:35.064716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-3828a4e7-3dcd-43b6-bb43-439840a17195 req-0fa62679-c34a-4407-81b3-dabf804e3517 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088269 Nov 24 18:24:35.065748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 563/1123] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:35.102556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:35.116314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:35.118153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:35.120216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b58338e-ce64-4309-914f-dec08ee825fb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.170451 Nov 24 18:24:35.121088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 561/1124] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:34 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:35.651208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:35.652115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:35.658575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:35.666671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:35.666671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:35.666671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:35.691487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-54a7532a-a8d7-4f33-a735-526ee7c6c9df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Nov 24 18:24:35.692041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 564/1125] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:36.138795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:36.139425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:36.145618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:36.146110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:36.146880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:36.147316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:36.279153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:36.287040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:36.288517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:36.289594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1bfa54de-62de-40f8-adb1-d3699c380be8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1407 microversion: 2.20 time: 0.154509 Nov 24 18:24:36.290669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 562/1126] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:36 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:36.703096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:36.703996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:36.710441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:36.710886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:36.711874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:36.712889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:36.743659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-86ae5809-f718-42f3-abd4-6246534bc782 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Nov 24 18:24:36.744117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 565/1127] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:37.309356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:37.310788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:37.316695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.317140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.317949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.318377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.453183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:37.460753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:37.462782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:37.463901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77947c16-da1b-43e9-ac31-0db7bf16cacb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1598 microversion: 2.20 time: 0.159352 Nov 24 18:24:37.464451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 563/1128] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:37 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:37.482445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:37.482943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:37.488832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.489278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.490077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.490512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.577584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cac90f5e-ea59-462a-8793-4cbdd73be1e8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100013 Nov 24 18:24:37.578218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 566/1129] 10.222.0.53 () {60 vars in 1315 bytes} [Wed Nov 24 18:24:37 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:24:37.754866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:37.755893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:37.762435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.762889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.763681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:37.764296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:37.796485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-39f6bea4-9ece-4aeb-8ba6-264e7d45956b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Nov 24 18:24:37.797166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 564/1130] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:38.606806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:38.607655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:38.615824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:38.616782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:38.617751 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:38.619487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:38.692156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-9852834c-d082-4641-89f2-19d5032f5531 req-219e0812-fd92-4d45-ae0c-0acaee64f3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f647ca-2f72-4260-93ad-0b9e49ec7d16", "tag": "906d31e1-a29f-435d-ab11-d57c4a281fa9"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:38.692156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:24:38.692156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:24:38.698676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9852834c-d082-4641-89f2-19d5032f5531 req-219e0812-fd92-4d45-ae0c-0acaee64f3d6 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:38.699279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9852834c-d082-4641-89f2-19d5032f5531 req-219e0812-fd92-4d45-ae0c-0acaee64f3d6 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:38.704843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ad9a53b-c22d-4a3e-9e7e-4a6df5adb434 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.101757 Nov 24 18:24:38.709028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 567/1131] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:38 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:38.711872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-9852834c-d082-4641-89f2-19d5032f5531 req-219e0812-fd92-4d45-ae0c-0acaee64f3d6 service nova] Creating event network-changed:906d31e1-a29f-435d-ab11-d57c4a281fa9 for instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 on hv-cinder-80403 Nov 24 18:24:38.718855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-9852834c-d082-4641-89f2-19d5032f5531 req-219e0812-fd92-4d45-ae0c-0acaee64f3d6 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113064 Nov 24 18:24:38.719843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 565/1132] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:24:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:38.811184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:38.812764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:38.821327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:38.828767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:38.828767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:38.828767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:38.859936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1bd877a0-7b9a-4785-8e06-1e030ec5fbcb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054268 Nov 24 18:24:38.863817 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 568/1133] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:39.717293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:39.718986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:39.728968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:39.729410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:39.730444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:39.736678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:39.804298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d2aca993-95d2-44e9-bb73-f62b996e4347 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.092310 Nov 24 18:24:39.805420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 566/1134] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:39 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:39.874854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:39.875753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:39.882584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:39.883258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:39.885538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:39.886145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:39.915248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d6d9c263-ce8f-4dc9-a77e-39788e96a483 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Nov 24 18:24:39.915838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 569/1135] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:40.817206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:40.818272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:40.825750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:40.826222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:40.827006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:40.827580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:40.894473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-924db85c-5bb4-4630-85b4-6d5a5ec2fd5e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.082639 Nov 24 18:24:40.895108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 567/1136] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:40 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:24:40.926951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:40.927871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:40.934492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:40.934946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:40.935734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:40.936170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:40.973914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4fe72c23-ccc0-43ab-8d60-9c066e068ace tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051058 Nov 24 18:24:40.974398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 570/1137] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:41.905116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:41.906231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:41.913009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:41.913463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:41.914271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:41.914729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:41.973919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f12198bf-a7a4-454c-983f-15ce3dd773cf tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.072767 Nov 24 18:24:41.974546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 568/1138] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:41 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:41.985043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:41.986002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:41.992391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:41.992833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:41.993705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:41.994319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:42.022654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7b7ba82a-f706-4d19-b74d-f72e30ee462f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 Nov 24 18:24:42.023200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 571/1139] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:42.985342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:42.986364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:42.993119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:42.994202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:42.994974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:42.995408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:43.034258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:43.035162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:43.041768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:43.042228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:43.042996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:43.043421 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:43.060380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10709446-7b15-406e-ba29-af462cfe450c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.078972 Nov 24 18:24:43.064123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 569/1140] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:42 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:43.073375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8d827a99-1b6c-49d5-b87f-103b9e04783f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042740 Nov 24 18:24:43.073957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 572/1141] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:44.071754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:44.072658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:44.079527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:44.079968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:44.080737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:44.081175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:44.084118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:44.085027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:44.092454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:44.092901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:44.093676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:44.094135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:44.125131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bdb9bd55-7532-4b8d-bec8-6a52b16ebe75 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 Nov 24 18:24:44.125698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 573/1142] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:44.143745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-36608717-4b6f-42ae-a6da-e5c824f10b97 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.075950 Nov 24 18:24:44.144383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 570/1143] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:44 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:45.136331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:45.137169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:45.143469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:45.143926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:45.144701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:45.145138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:45.155315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:45.156332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:45.163037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:45.163488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:45.164261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:45.164695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:45.175784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f31f8912-687a-4158-9cf8-c9ac2cec9ae7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Nov 24 18:24:45.176339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 574/1144] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:45.223354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-51f9002e-8099-4946-8b36-edfaf511f85a tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.071907 Nov 24 18:24:45.223962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 571/1145] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:45 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:24:46.187168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:46.188233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:46.194416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:46.194843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:46.195615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:46.196045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:46.226185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9f438f44-efe3-4bb2-a791-3add34568fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042640 Nov 24 18:24:46.226740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 575/1146] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:46.234330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:46.235319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:46.242256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:46.242703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:46.243657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:46.244094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:46.304146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a168ba27-4f54-4f37-aec8-916dfb0be517 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.073709 Nov 24 18:24:46.304756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 572/1147] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:46 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:47.237033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:47.237927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:47.245130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:47.245583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:47.246414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:47.246847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:47.276177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-47c7170d-a6c9-4c4c-8995-1cff141ebf48 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Nov 24 18:24:47.276721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 576/1148] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:47.315871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:47.316900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:47.324359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:47.324808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:47.325582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:47.326053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:47.394243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c176dc3-bc2f-44c0-9b21-415440903046 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.082346 Nov 24 18:24:47.394854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 573/1149] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:47 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:24:48.287474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:48.288313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:48.295047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:48.295497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:48.296265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:48.296700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:48.325989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d67f2a61-2e4d-4059-a35a-d2a3ec997b7d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Nov 24 18:24:48.326533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 577/1150] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:48.405618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:48.406641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:48.413430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:48.413909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:48.414687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:48.415292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:48.482768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-12f3a257-85fc-4eb2-9c67-d039650a7df6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 14 microversion: 2.20 time: 0.081089 Nov 24 18:24:48.483541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 574/1151] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:48 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:24:49.227304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:49.228318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:49.234234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.234692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.235506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.235946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.273193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5836b071-cec9-40fe-b253-9427f27e6954 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049493 Nov 24 18:24:49.273752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 578/1152] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:24:49.338435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:49.339442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:49.346235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.346687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.347468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.347910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.377690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0ddad7e7-c4b4-46f1-bf05-f500300a9c70 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Nov 24 18:24:49.378289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 575/1153] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:49.492803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:49.494737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:49.500870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.501315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.502112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:49.502545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:49.574295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0edc34b3-ddee-4bf3-bcd0-c2808f0b96ef tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 10658 microversion: 2.20 time: 0.084890 Nov 24 18:24:49.574923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 579/1154] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:49 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 10658 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:50.285221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:50.286193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:50.293051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.293415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.294224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.294655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.326767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5cb5f98-224c-446d-8f13-a924f27e5d6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Nov 24 18:24:50.327680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 576/1155] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:50.389848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:50.390875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:50.397663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.398141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.398916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.399356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.429474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0842142c-496d-44f9-8d8d-6645349cc4f7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Nov 24 18:24:50.430062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 580/1156] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:50.584441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:50.585341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:50.591517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.591962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.592723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:50.593150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:50.675942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab1c2430-914c-4ac6-9420-1ddaf47902b6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 17686 microversion: 2.20 time: 0.095135 Nov 24 18:24:50.676557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 577/1157] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:50 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 17686 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:51.338079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:51.340066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:51.346440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.346893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.347680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.348121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.377636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-60d25d90-7292-4223-8a49-e06275d89e47 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043308 Nov 24 18:24:51.378243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 581/1158] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:51.441548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:51.442501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:51.449963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.450417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.451198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.451635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.482419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-044a9b27-aef4-4fea-9f6b-a4c048e85a0e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Nov 24 18:24:51.482981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 578/1159] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:51.687674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:51.688573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:51.694789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.695169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.695927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:51.696351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:51.767108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e4d37452-34eb-4433-bb49-695df5f7ce34 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 18449 microversion: 2.20 time: 0.082999 Nov 24 18:24:51.767725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 582/1160] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:51 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 18449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:52.389043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:52.389729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:52.395710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.396157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.396929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.397368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.426082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d9f7214c-2fe9-4ff8-924a-2a83c0fb4c7c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Nov 24 18:24:52.426629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 579/1161] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:52.493605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:52.494635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:52.502250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.502641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.503414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.503850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.534254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-139d347d-d974-4bd2-bd8d-a7ec852c75d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Nov 24 18:24:52.534818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 583/1162] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:52.782320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:52.782320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:52.785994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.786438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.787201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:52.787625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:52.859542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7ae3507-6046-4fff-8b89-2bcbba6ccc6d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 21457 microversion: 2.20 time: 0.084465 Nov 24 18:24:52.860173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 580/1163] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:52 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 21457 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:24:53.437964 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:53.438873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:53.445037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.445481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.446314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.446743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.476068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-088ebece-98a6-4517-9400-c6f6bcebbe4f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041948 Nov 24 18:24:53.476625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 584/1164] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:53.546299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:53.547486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:53.554206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.554652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.555426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.555851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.585625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6c0873d6-fce1-440d-8a5a-de0693a3dccb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Nov 24 18:24:53.586197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 581/1165] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:53.871080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:53.871916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:53.878206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.878659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.879428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:53.879868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:53.951091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a41e892b-b578-43c4-a8c1-07e39e546365 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 23180 microversion: 2.20 time: 0.083754 Nov 24 18:24:53.951706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 585/1166] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:53 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 23180 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:54.487957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:54.488860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:54.494966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.496071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:54.496858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.497286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:54.526488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0175396a-1d05-43b0-ba6d-3e6b03d99af7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Nov 24 18:24:54.527701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 582/1167] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:54.597009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:54.597986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:54.605511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.606289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:54.607068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.607506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:54.636108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-01fb6585-d165-4f8b-80c7-bdcb6a48d3b0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Nov 24 18:24:54.636662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 586/1168] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:54.962563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:54.963476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:54.970288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.970736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:54.972331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:54.972331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:55.041191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6b2c1006-d994-42b8-b07d-076b4a82bfb6 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 24420 microversion: 2.20 time: 0.082174 Nov 24 18:24:55.041840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 583/1169] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:54 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 24420 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:55.538276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:55.539220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:55.546189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:55.546637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:55.547678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:55.548117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:55.578596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-54f96ba4-c3e1-4cfe-b914-f28c678fa199 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Nov 24 18:24:55.579154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 587/1170] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:55.647944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:55.648877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:55.656303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:55.656752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:55.657522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:55.657985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:55.687679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-476c7762-4120-4a47-af1c-aecc5e8630bd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Nov 24 18:24:55.688223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 584/1171] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:56.052738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:56.053644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:56.060386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.060827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.061584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.062038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.132251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-26d7578d-97a3-4546-8d52-dda5516af2ae tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 26065 microversion: 2.20 time: 0.083129 Nov 24 18:24:56.132898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 588/1172] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:56 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 26065 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:56.590118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:56.591155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:56.597312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.597778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.598590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.599024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.630286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8f074bd2-d13f-4af8-ae19-3583c01efbd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Nov 24 18:24:56.630838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 585/1173] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:56.700148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:56.701073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:56.707752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.708199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.708962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:56.709387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:56.738829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b236ecd2-d17f-420e-871c-f6d99640d173 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Nov 24 18:24:56.739369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 589/1174] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:57.144478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:57.145309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:57.151495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.151947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.152723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.153157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.229419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-24f7f60e-7298-4a90-9c33-76eed3d29ff7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 27299 microversion: 2.20 time: 0.088655 Nov 24 18:24:57.230653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 586/1175] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:57 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 27299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:57.641145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:57.642151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:57.648323 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.648771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.649540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.650001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.679647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cb6fe106-f068-4b58-9a07-2d38c199ef15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Nov 24 18:24:57.680192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 590/1176] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:57.750810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:57.751772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:57.758566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.759021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.759797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:57.760238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:57.790349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1ab87187-ed63-4a56-b007-0dc25bfa8489 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Nov 24 18:24:57.790950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 587/1177] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:58.241549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:58.242481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:58.249504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.249995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.250780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.251220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.326038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d2df8aea-2ba0-495c-b4f4-e310877c9399 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 27950 microversion: 2.20 time: 0.087900 Nov 24 18:24:58.326660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 591/1178] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:58 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 27950 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:24:58.691047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:58.691978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:58.698157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.699195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.699955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.700392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.729345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eef29dee-97d3-4b2c-8baf-c0dff061ba68 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Nov 24 18:24:58.730658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 588/1179] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:58.803063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:58.803985 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:58.811341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.811779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.812541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:58.812965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:58.842763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-02acfb94-7c6b-439e-9fd1-c468e173ff4e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Nov 24 18:24:58.843311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 592/1180] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:59.337435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:59.338380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:59.345022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.345462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.346249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.346680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.422447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-60ddb98e-76f8-4a00-842b-46dc7ddfb257 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28206 microversion: 2.20 time: 0.088244 Nov 24 18:24:59.423075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 589/1181] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:59 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28206 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:24:59.741306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:59.742252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:59.749465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.749958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.750731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.751166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.780546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2f276a10-0727-4da6-bc54-e7ffd1ef8527 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Nov 24 18:24:59.781086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 593/1182] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:24:59.854793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:59.855801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:24:59.862904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.863354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.864157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:24:59.864596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:24:59.894204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-54f4e508-b8d7-4068-be9f-0098c4e58dab tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Nov 24 18:24:59.894756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 590/1183] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:24:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:00.434374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:00.435285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:00.441499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.441988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.442759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.443191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.505320 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d9724339-b828-4316-baa4-426546ffc062 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28206 microversion: 2.20 time: 0.075586 Nov 24 18:25:00.506064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 594/1184] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:00 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28206 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:00.791719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:00.792638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:00.799034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.799474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.800232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.800660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.830552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aaa5b5d3-ffa1-4853-ac9c-d70372a37599 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Nov 24 18:25:00.831087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 591/1185] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:00.904976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:00.906002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:00.912726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.913196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.913982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:00.914414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:00.943866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2a19edfb-0984-4a72-96b1-dc36daddbebc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Nov 24 18:25:00.944332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 595/1186] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:01.516596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:01.517451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:01.523688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.524139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.524914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.525349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.600507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5488faea-8df2-4f92-ad03-56c45145f80c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28497 microversion: 2.20 time: 0.087575 Nov 24 18:25:01.601428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 592/1187] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:01 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28497 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:01.842483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:01.843393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:01.849521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.850011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.850793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.851226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.879860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d9e64d28-7d46-4664-8949-09040bdc5993 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 Nov 24 18:25:01.880409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 596/1188] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:01.955797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:01.956726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:01.963780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.964431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.965212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:01.965647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:01.994894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9db8b274-a3c4-4828-aea5-8d5cba66f24d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Nov 24 18:25:01.996148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 593/1189] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:02.611926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:02.612871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:02.619224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:02.619670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:02.620562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:02.621006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:02.699712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ff705f30-8f2c-4029-863d-76cdc4c821d8 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28665 microversion: 2.20 time: 0.091325 Nov 24 18:25:02.700327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 597/1190] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:02 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:02.891837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:02.892759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:02.899027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:02.899480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:02.900259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:02.900693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:02.930302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dfaf3e14-4643-4fce-93fa-7ccaa857bdd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042221 Nov 24 18:25:02.930851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 594/1191] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:03.007259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:03.008250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:03.016055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.016499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.017259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.017695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.045962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e77bb371-c77d-4cf4-84fd-97170e8ce629 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Nov 24 18:25:03.046505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 598/1192] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:03.711162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:03.712109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:03.718863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.719317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.720098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.720537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.783144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5af6e513-986e-429c-80c2-6645019ac23d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28665 microversion: 2.20 time: 0.075402 Nov 24 18:25:03.783990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 595/1193] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:03 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28665 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:03.942116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:03.943033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:03.949288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.949743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.950551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:03.950989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:03.979295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c812a3c9-e96e-462a-a209-7e4f2f426c7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040904 Nov 24 18:25:03.979841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 599/1194] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:04.058015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:04.058955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:04.066478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:04.066924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:04.067697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:04.068131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:04.096811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fbc59366-a1c4-4764-9dc4-5a4c4d13a1e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Nov 24 18:25:04.097349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 596/1195] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:04.795275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:04.796187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:04.803145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:04.803593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:04.804368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:04.804797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:04.868573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-326ef2aa-407d-4319-8f6e-000647c84b35 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 28665 microversion: 2.20 time: 0.077446 Nov 24 18:25:04.873358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 600/1196] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:04 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 28665 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:04.991974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:04.992893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:05.000214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.000663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.001440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.001911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.031130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b38076ce-a121-4ca6-b939-4075604832e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 Nov 24 18:25:05.031681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 597/1197] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:05.109344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:05.110310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:05.117191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.117670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.118490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.118926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.148512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-43cc81fb-39ac-42bd-bf02-96d11a936375 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Nov 24 18:25:05.149077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 601/1198] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:05.880338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:05.881199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:05.887437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.887891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.888850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:05.889965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:05.966192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9ff15f16-0012-431a-b7fb-708f0fda2ad5 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 30011 microversion: 2.20 time: 0.089422 Nov 24 18:25:05.968430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 598/1199] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:05 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 30011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:25:06.042186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:06.043172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:06.049731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.050216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:06.050986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.051421 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:06.080648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b75f0a5-94b7-4d5c-9ab4-84f38390dbae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Nov 24 18:25:06.081207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 602/1200] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:06.160554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:06.161626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:06.168470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.169048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:06.169861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.170903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:06.200811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-94c8d6a7-5e9c-4a46-a186-c99c50789be9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Nov 24 18:25:06.201409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 599/1201] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:06.978816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:06.979745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:06.986311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.986758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:06.987528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:06.987962 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:07.068237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-879f6771-bcd3-4d38-adb0-c635eaece8e2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 32126 microversion: 2.20 time: 0.092856 Nov 24 18:25:07.068876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 603/1202] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:06 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 32126 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:07.091310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:07.092220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:07.099090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:07.099532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:07.100296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:07.100725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:07.129276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eacbfa3d-186e-4148-aa57-287adc599c8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Nov 24 18:25:07.129843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 600/1203] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:07.212852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:07.213895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:07.221476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:07.221951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:07.222727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:07.223152 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:07.252841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-84ccba43-7868-429a-aee7-4949fab14138 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Nov 24 18:25:07.253388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 604/1204] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:08.080232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:08.081134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:08.087461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.087903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.088669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.089099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.140580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:08.141492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:08.147729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.148176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.148946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.149379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.164030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-30d7b31b-66ea-4779-8780-8536b9e1659f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 33513 microversion: 2.20 time: 0.087358 Nov 24 18:25:08.168245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 601/1205] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:08 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 33513 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:08.179633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e3446d72-b316-4a4c-9339-3174c8a7018f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Nov 24 18:25:08.180184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 605/1206] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:08.264626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:08.265886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:08.272742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.273199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.274008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:08.274453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:08.304728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4d404f0c-469c-4fb1-9431-da20c51d2123 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Nov 24 18:25:08.305269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 602/1207] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:09.176726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:09.177752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:09.184036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.185057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.185398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.185941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.191834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:09.192757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:09.199045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.199502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.200291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.200730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.231024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9e116553-e22d-4729-b37c-73a0548f4c18 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042964 Nov 24 18:25:09.231580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 603/1208] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:09.259634 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2a1d88ec-14df-48ba-9557-8117be4a73a7 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 34628 microversion: 2.20 time: 0.086407 Nov 24 18:25:09.260274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 606/1209] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:09 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 34628 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:25:09.316240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:09.317110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:09.323290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.323742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.324518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:09.324955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:09.354164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff8e45c2-bfa9-4813-9d9f-fe509a06c349 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Nov 24 18:25:09.354706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 604/1210] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:10.243261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:10.244265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:10.251683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.252071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.252847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.253287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.271304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:10.272217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:10.278013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.278458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.279233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.279669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.284689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-233267f0-e5b1-4c64-abad-355092adbb28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045445 Nov 24 18:25:10.285252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 607/1211] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:10.352125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3989a6cb-449a-4910-b7d0-87957f5540eb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 35762 microversion: 2.20 time: 0.084344 Nov 24 18:25:10.352750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 605/1212] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:10 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 35762 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:25:10.365859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:10.366783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:10.373066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.374097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.374993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:10.375437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:10.404346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e085cef9-c5c9-4d9a-a182-275f02238e8a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042174 Nov 24 18:25:10.404896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 608/1213] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:11.296405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:11.297669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:11.304524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.305008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.305807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.306250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.336102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-56ec4860-5423-42c6-808e-987c00ece272 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Nov 24 18:25:11.336653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 606/1214] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:11.364319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:11.365233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:11.371443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.371894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.372669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.373106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.415828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:11.416769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:11.425023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.425502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.426307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:11.426742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:11.447489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-560ed58d-22d5-49b5-9df0-67d3670d4508 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 37460 microversion: 2.20 time: 0.086696 Nov 24 18:25:11.448396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 609/1215] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:11 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 37460 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:25:11.457623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c1f3b33e-40d5-4b78-b3f9-9a1372f9acee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Nov 24 18:25:11.458234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 607/1216] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:12.348469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:12.349465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:12.356268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.356715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.357487 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.357957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.388164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5991103c-3108-4134-9c22-463c2ada2a04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Nov 24 18:25:12.388764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 610/1217] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:12.460127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:12.461033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:12.468214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.468656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.469244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:12.469425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.469953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.470176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:12.476347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.476800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.477571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:12.478025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:12.506958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6af80d0a-cf23-4d31-9327-757c1aa3bbb1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041941 Nov 24 18:25:12.507505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 611/1218] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:12.555309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-17353ead-b499-4a89-980e-6cf6a4fc24ec tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 38222 microversion: 2.20 time: 0.098539 Nov 24 18:25:12.555913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 608/1219] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:12 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 38222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:13.399896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:13.400810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:13.407627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.408074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.408843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.409281 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.438268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df181be1-f223-4731-adde-fcad08cd4410 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Nov 24 18:25:13.438810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 612/1220] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:13.518896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:13.519816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:13.526518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.526961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.527724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.528151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.558114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-241bd00e-ab2f-41f8-b6a8-0e77a618091f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Nov 24 18:25:13.558670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 609/1221] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:13.567077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:13.568019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:13.574343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.574793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.575568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:13.576005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:13.638950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-46f9d795-417d-4553-88d5-7d2ee9381c89 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 38222 microversion: 2.20 time: 0.075394 Nov 24 18:25:13.640602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 613/1222] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:13 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 38222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:14.448684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:14.449631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:14.456635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.457086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.457894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.458334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.487216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-295349c9-c00e-4ce0-9c63-a51179d56eab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Nov 24 18:25:14.487763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 610/1223] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:14.570686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:14.571826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:14.579555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.580007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.580782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.581266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.610623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ff09922-e52d-4cd1-8f20-48fb04235a19 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Nov 24 18:25:14.611169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 614/1224] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:14.651301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:14.652276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:14.659382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.659834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.660613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:14.661050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:14.722467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-461a7bbf-2e54-45f7-9c51-8ab881b8920f tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 38222 microversion: 2.20 time: 0.074692 Nov 24 18:25:14.723113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 611/1225] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:14 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 38222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:15.498322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:15.499948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:15.506125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.506576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.507350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.507784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.536966 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-407616c0-1f38-43c1-8a02-e62e74060f43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Nov 24 18:25:15.537513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 615/1226] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:15.622534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:15.623969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:15.630803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.631251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.632022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.632466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.662805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c0f7d444-f80a-423a-ab63-543a338e09a2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Nov 24 18:25:15.663440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 612/1227] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:15.734369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:15.735280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:15.741464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.741954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.751336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:15.751336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:15.805022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c740b857-0933-416a-8cd7-9b8e1d49c678 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 38222 microversion: 2.20 time: 0.074191 Nov 24 18:25:15.805681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 616/1228] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:15 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 38222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:16.548668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:16.549577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:16.556328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.556785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.557561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.558023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.588677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8527fe6d-3b55-4d3d-827b-d01e87d0b048 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Nov 24 18:25:16.589230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 613/1229] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:16.674983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:16.675987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:16.682947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.683399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.684174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.684609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.714233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e94e1595-e6af-4212-80c2-3ec27a22fd0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Nov 24 18:25:16.714781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 617/1230] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:16.816639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:16.817585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:16.823934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.824387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.825163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.825604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.897537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c432903-2c06-476e-9f63-c44c518d7d8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action" status: 200 len: 38365 microversion: 2.20 time: 0.084496 Nov 24 18:25:16.898237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 614/1231] 10.222.0.53 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:16 2021] POST /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/action => generated 38365 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:25:16.908691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:16.909182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:16.915401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.915848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.916617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:16.917051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:16.940170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-60613948-b1fe-48ed-80f7-d7f3f32b7f3c tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/ips" status: 200 len: 151 microversion: 2.20 time: 0.035780 Nov 24 18:25:16.940654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 618/1232] 10.222.0.53 () {60 vars in 1288 bytes} [Wed Nov 24 18:25:16 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:25:17.600680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:17.601678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:17.608454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:17.609054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:17.613372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:17.613372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:17.640591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-813f37c8-9f7b-4acd-ba8b-6454ce36ab8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Nov 24 18:25:17.640591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 615/1233] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:17.726325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:17.727147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:17.733809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:17.734258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:17.735020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:17.735453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:17.767047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-418a89e1-d323-4fc3-af43-43d56f5bf6a5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Nov 24 18:25:17.767601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 619/1234] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:18.651295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:18.652248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:18.658651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:18.659099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:18.659876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:18.660315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:18.689224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef02d49f-6316-4b27-81b3-46adc7605e1e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Nov 24 18:25:18.689710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 616/1235] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:18.778359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:18.779283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:18.788957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:18.788957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:18.788957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:18.788957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:18.828706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f17eb851-53fb-42ea-bab0-dda6574d3b44 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054010 Nov 24 18:25:18.829496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 620/1236] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:19.700121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:19.701063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:19.708260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:19.708748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:19.709520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:19.709982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:19.738635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3aff0919-4144-4324-bf76-5b973e1a2554 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Nov 24 18:25:19.739115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 617/1237] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:19.840074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:19.841110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:19.847981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:19.848422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:19.849182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:19.849609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:19.878771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b10c68e-80b7-4197-a998-645d3adf04b3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Nov 24 18:25:19.879318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 621/1238] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:20.750053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:20.750963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:20.757441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:20.757915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:20.758681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:20.759110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:20.787973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ba6e44f3-d56e-4872-ad4a-391d0f1fcab3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Nov 24 18:25:20.788452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 618/1239] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:20.890540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:20.891454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:20.897739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:20.898217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:20.898984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:20.899417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:20.929462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f0bc7f2e-99ae-40c1-b5b6-0ca55d946ab7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Nov 24 18:25:20.930033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 622/1240] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:21.799340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:21.800248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:21.806456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:21.806896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:21.807709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:21.808090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:21.837461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5ced66b1-008d-41f3-98d5-3f3c9bb51ff8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Nov 24 18:25:21.838032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 619/1241] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:21.940638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:21.941579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:21.947795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:21.948251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:21.949011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:21.949442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:21.979339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f2eddb82-9efa-4a70-ab7d-dcea0000537c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Nov 24 18:25:21.979883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 623/1242] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:22.849273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:22.850212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:22.856329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:22.856768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:22.857537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:22.858117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:22.886253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fd53266f-18d8-4802-83e3-c7aa7b2f9d40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 Nov 24 18:25:22.886983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 620/1243] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:22.991048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:22.991984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:22.998132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:22.998618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:22.999375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:22.999805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:23.027350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-19df976c-81b9-4aa2-80b1-08ff189a0788 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040025 Nov 24 18:25:23.027881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 624/1244] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:23.898044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:23.898962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:23.905211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:23.905607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:23.906418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:23.906855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:23.935424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ea0a2d27-ddce-49d9-be1a-c96794a486da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 Nov 24 18:25:23.936489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 621/1245] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:24.039269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:24.040185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:24.047754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:24.048203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:24.049018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:24.049456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:24.078803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-12625534-bb98-4e90-ab2e-92e66197cbb5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Nov 24 18:25:24.079285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 625/1246] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:24.947649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:24.948643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:24.955402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:24.955853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:24.956650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:24.957072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:24.986280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bd3cf558-1433-4ee6-869b-c884d8d22650 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Nov 24 18:25:24.986838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 622/1247] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:25.089959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:25.090819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:25.097204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:25.097655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:25.098465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:25.098907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:25.128226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a1156a6b-4755-469c-90ba-c69f597c14f2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Nov 24 18:25:25.128770 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 626/1248] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:25.997478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:25.999020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:26.005224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:26.005670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:26.006476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:26.006907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:26.036242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a40c40ef-003e-49dc-98c2-8893b33b52aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Nov 24 18:25:26.040105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 623/1249] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:26.139692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:26.140650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:26.146877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:26.147324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:26.148100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:26.148536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:26.178545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e337f3bd-9692-4fce-8a11-02c3162a3367 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Nov 24 18:25:26.179095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 627/1250] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:27.050592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:27.051498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:27.057833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:27.058291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:27.059135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:27.059571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:27.089696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-478598e6-714b-4079-a6e1-57167e90fa9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043028 Nov 24 18:25:27.090297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 624/1251] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:27.189789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:27.190734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:27.197061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:27.197925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:27.198390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:27.198826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:27.228801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-215e4749-d96f-493f-aa67-45233f3404ff tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Nov 24 18:25:27.229349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 628/1252] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:28.102157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:28.103074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:28.109467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:28.109906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:28.110684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:28.111124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:28.139735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-feaa1e1d-e7e4-4200-8da5-30f4ae304c75 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Nov 24 18:25:28.140276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 625/1253] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:28.239808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:28.240750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:28.246975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:28.247422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:28.248225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:28.249696 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:28.279242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cf094bca-f948-44e1-8026-d85477cf66c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Nov 24 18:25:28.279826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 629/1254] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:29.150766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:29.151685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:29.158262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:29.158661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:29.159443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:29.159887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:29.189186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a922d914-f5f9-4ea5-8d47-9b8880bcddae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Nov 24 18:25:29.189731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 626/1255] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:29.290247 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:29.291157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:29.298663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:29.299114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:29.299886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:29.300315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:29.330358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f220f276-5ac0-4d59-a955-600a5a1fe63c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Nov 24 18:25:29.330916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 630/1256] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:30.200254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:30.201078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:30.207715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:30.208157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:30.208915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:30.209343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:30.237729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dc8678ae-53a4-4380-93ee-9c867b6eac66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 Nov 24 18:25:30.238297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 627/1257] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:30.341436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:30.342970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:30.349426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:30.349915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:30.350705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:30.351268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:30.380602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c1395ee1-0695-45f0-9dbb-682ccba562d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Nov 24 18:25:30.381167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 631/1258] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:31.248158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:31.249967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:31.256108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:31.256561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:31.257332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:31.257813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:31.286993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c811960-e756-4e9b-8ddb-7b9b0961f143 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Nov 24 18:25:31.287538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 628/1259] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:31.392675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:31.394335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:31.401214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:31.401670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:31.402548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:31.402992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:31.433577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-894473d6-a438-4b86-b9de-d10649f76914 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Nov 24 18:25:31.434172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 632/1260] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:32.298589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:32.299440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:32.305670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:32.306154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:32.306933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:32.307373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:32.336609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe97f1cb-a558-4640-b037-969ed8712a33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Nov 24 18:25:32.337163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 629/1261] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:32.444750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:32.445659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:32.452676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:32.453119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:32.453996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:32.454432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:32.483974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-62c469d8-1e7a-4deb-a58e-ce9d763dedc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Nov 24 18:25:32.484512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 633/1262] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:33.347852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:33.348803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:33.355008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:33.355453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:33.356214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:33.356644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:33.386144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e78cfa04-ab15-42cc-92b9-e418a59f29a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 Nov 24 18:25:33.386695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 630/1263] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:33.494499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:33.495404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:33.501996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:33.502449 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:33.503228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:33.503674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:33.532482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ac54ec6-0834-4de1-a084-88614c8e7882 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Nov 24 18:25:33.533066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 634/1264] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:34.397373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:34.398312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:34.404510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:34.404962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:34.405740 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:34.406536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:34.435071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4d184bf7-fddb-423e-8b48-24e643a255ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Nov 24 18:25:34.435641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 631/1265] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:34.543688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:34.544600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:34.551484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:34.552384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:34.553165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:34.553605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:34.582979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-429fa6da-195f-478c-9350-f22f38e1e45e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Nov 24 18:25:34.583531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 635/1266] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:35.446125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:35.446968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:35.454005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:35.454458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:35.455232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:35.455672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:35.484475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d5b0a83-4b55-49ff-8751-354ab44ead50 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Nov 24 18:25:35.485031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 632/1267] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:35.594638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:35.595550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:35.601722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:35.602202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:35.602972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:35.603403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:35.680712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ef9e80cd-0bc1-414b-95a3-e79646ae7b0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action" status: 200 len: 104542 microversion: 2.1 time: 0.090312 Nov 24 18:25:35.681674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 636/1268] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:25:35 2021] POST /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f/action => generated 104542 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:36.495696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:36.496549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:36.502837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:36.503290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:36.504066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:36.504505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:36.532964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7de76a0a-7ce9-4eb6-98d9-8410961beecc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Nov 24 18:25:36.533511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 633/1269] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:37.544053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:37.545041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:37.552939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:37.553386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:37.554186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:37.554615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:37.585104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-997ac4e6-e708-41be-9f26-bd25a6b2b444 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Nov 24 18:25:37.585651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 637/1270] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:38.596304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:38.597253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:38.603529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:38.603978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:38.604755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:38.605194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:38.635479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2df8eada-247c-4316-a285-587deef0b275 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Nov 24 18:25:38.636042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 634/1271] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:39.646730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:39.647608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:39.653812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:39.654261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:39.655034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:39.655472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:39.685534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cde00068-c820-426a-86d8-7f1432e17177 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Nov 24 18:25:39.686116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 638/1272] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:40.696162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:40.697074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:40.703785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:40.704225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:40.704987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:40.705422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:40.734834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a71e6aa1-33b2-4bac-ac2f-22d410f1d5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Nov 24 18:25:40.735392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 635/1273] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:41.746129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:41.747073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:41.754028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:41.754488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:41.755257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:41.756030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:41.784472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-48b2b639-c314-4e1e-80bd-f8a8e41211a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 Nov 24 18:25:41.785017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 639/1274] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:42.795850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:42.797654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:42.803848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:42.804292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:42.805059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:42.805501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:42.833936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ae7962c0-0b7f-4e52-93e8-b08b4b6ead01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Nov 24 18:25:42.834484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 636/1275] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:43.845519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:43.846456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:43.852616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:43.853060 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:43.853856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:43.854295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:43.882378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-572e0c27-908d-48af-8739-4bb2d7d69a3b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Nov 24 18:25:43.882914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 640/1276] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:44.893613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:44.894552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:44.900710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:44.901160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:44.901957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:44.902395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:44.930717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-12fdb3e2-1a07-4916-b6e6-c5ada540eeb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Nov 24 18:25:44.931266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 637/1277] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:45.941958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:45.942874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:45.949073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:45.949519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:45.950333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:45.950766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:45.979843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fcff173f-d410-417a-978e-334af54f504c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Nov 24 18:25:45.980387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 641/1278] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:46.990525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:46.994795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:46.997483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:46.997976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:46.998739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:46.999170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:47.028523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e92a94c6-4529-4e78-9b88-2fb691fe6e56 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Nov 24 18:25:47.029073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 638/1279] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:47.188664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:25:47.189159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:25:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:25:48.039656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:48.040565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:48.048112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:48.048561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:48.049348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:48.049813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:48.079981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b2475109-1444-4f96-b021-fb54033bc7e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Nov 24 18:25:48.080464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 642/1280] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:49.215719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:49.216629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:49.222554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:49.223005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:49.223784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:49.224223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:49.253038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0aa74fb5-fa9e-4c9d-8aa0-3a777d2a5604 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165261 Nov 24 18:25:49.253591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 639/1281] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:50.264268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:50.265197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:50.271496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:50.271947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:50.272721 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:50.273158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:50.302586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1f2ceee5-2c33-41e5-8dd2-f03b48b326b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042031 Nov 24 18:25:50.303130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 643/1282] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:51.313891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:51.314807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:51.320981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:51.321429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:51.322227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:51.322660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:51.351487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5ca8fbe7-5784-4553-83a4-45e1de22443b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Nov 24 18:25:51.352033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 640/1283] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:52.363265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:52.364227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:52.370491 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:52.370941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:52.371713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:52.372150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:52.401460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-542a174b-2668-4e39-a867-7ccdd0437b13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Nov 24 18:25:52.402048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 644/1284] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:53.412810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:53.413728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:53.419996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:53.420449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:53.421223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:53.421956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:53.449764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9c279d05-743c-4b79-9ab0-35852c71bb88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040948 Nov 24 18:25:53.450330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 641/1285] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:54.460504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:54.461416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:54.467598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:54.468064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:54.469561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:54.470013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:54.499033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e3900cc3-8c19-447d-a6c0-ecce42aa3a2a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042159 Nov 24 18:25:54.500203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 645/1286] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:55.511199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:55.512180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:55.518989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:55.523064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:55.523064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:55.523064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:55.551344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ca9dce34-89f5-4cab-9f40-aa6a39150529 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Nov 24 18:25:55.551911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 642/1287] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:56.563268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:56.564223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:56.570409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:56.570852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:56.571617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:56.572044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:56.600274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ac389417-3dd6-4f8a-b16f-545ea03ac6dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Nov 24 18:25:56.600813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 646/1288] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:57.612103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:57.613017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:57.619362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:57.619809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:57.620578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:57.621011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:57.649056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c186f284-69eb-4569-9408-1acb8f597957 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Nov 24 18:25:57.649601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 643/1289] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:58.660335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:58.661253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:58.667562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:58.668014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:58.668819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:58.669254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:58.698214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e47b15f8-6cf5-4949-bfda-c4e444d525ce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Nov 24 18:25:58.698757 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 647/1290] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:59.709782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:59.710693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:25:59.716928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:59.717380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:59.718237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:25:59.718741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:25:59.746790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-db079e85-f766-42db-9e64-b29316636ac0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 Nov 24 18:25:59.747343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 644/1291] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:25:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:00.759097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:00.760011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:00.767599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:00.768055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:00.768838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:00.769277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:00.798687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8593abef-5c33-4ae1-8011-8168e989f0d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Nov 24 18:26:00.799240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 648/1292] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:01.809999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:01.810950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:01.817144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:01.817596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:01.818412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:01.818944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:01.848265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ba05f7f-5908-466b-886b-3f37d740a021 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042065 Nov 24 18:26:01.848813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 645/1293] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:02.859700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:02.860611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:02.866853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:02.867303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:02.868073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:02.868510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:02.897534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d890e2e-18c6-4265-94ef-f9b54ee82822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Nov 24 18:26:02.898117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 649/1294] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:03.908605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:03.909523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:03.915815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:03.916275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:03.917084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:03.917522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:03.947082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8f2257d0-a2a6-46c8-b712-2a843f52df52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Nov 24 18:26:03.947629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 646/1295] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:04.958115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:04.959028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:04.965250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:04.965692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:04.966489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:04.966919 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:04.994996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-53a4c6a5-d2e5-4645-923f-6233de6ec3e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Nov 24 18:26:04.995536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 650/1296] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:06.006438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:06.007356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:06.013520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:06.014015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:06.014789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:06.015859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:06.045176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-00d57f69-7730-4854-a82e-422d696a295e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Nov 24 18:26:06.045738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 647/1297] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:07.056706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:07.057646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:07.064118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:07.064563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:07.065330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:07.065775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:07.095670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0bcbe7fe-e53e-42a6-a8b6-53232d18469d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042620 Nov 24 18:26:07.096115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 651/1298] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:08.106650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:08.107558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:08.113914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:08.114359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:08.115125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:08.115555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:08.144708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-12bfe83e-56f5-4c15-b2c1-6ad2cfe8eebf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Nov 24 18:26:08.145395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 648/1299] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:09.156390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:09.157304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:09.163541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:09.163986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:09.164753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:09.165187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:09.193400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1449b33e-2224-427f-bf83-b1edb4ddac8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Nov 24 18:26:09.193892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 652/1300] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:10.204497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:10.205413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:10.211347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:10.211800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:10.212578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:10.213014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:10.242358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5235ed61-6442-4bd8-9df5-8e71e744424b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Nov 24 18:26:10.242852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 649/1301] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:11.254033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:11.254941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:11.260922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:11.261373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:11.262177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:11.262619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:11.291428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1c8c9e63-24ee-454a-af11-4885b0be5a70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041817 Nov 24 18:26:11.291974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 653/1302] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:12.302809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:12.303735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:12.309986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:12.310437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:12.311209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:12.311648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:12.339964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5ba83b5a-5b47-48eb-8c91-209144e53157 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040872 Nov 24 18:26:12.340512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 650/1303] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:13.351188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:13.352121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:13.358544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:13.359046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:13.359811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:13.360252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:13.389948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e27ddff4-d068-4011-bac4-a7e6af46530e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042424 Nov 24 18:26:13.390503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 654/1304] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:14.401178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:14.402152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:14.408885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:14.409336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:14.410137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:14.410580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:14.438571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bfcd494c-2fc3-4ef4-9bfc-500045a3b202 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Nov 24 18:26:14.439112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 651/1305] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:15.449667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:15.450695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:15.456969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:15.457418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:15.458501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:15.458938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:15.489236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3c095ac9-aa95-4dc7-a08f-05c70e0c5727 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Nov 24 18:26:15.489825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 655/1306] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:16.500423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:16.502150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:16.508322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:16.508771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:16.509554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:16.510017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:16.540016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9ba4a0f7-4662-4b58-a55f-7675e1b990d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Nov 24 18:26:16.540572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 652/1307] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:17.552201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:17.553122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:17.559648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:17.560281 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:17.561553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:17.562042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:17.601583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-76e403cf-d375-4f0d-af27-3f022cb13521 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053717 Nov 24 18:26:17.602162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 656/1308] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:18.612569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:18.613496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:18.619993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:18.620445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:18.621230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:18.621702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:18.658999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff549bd2-6671-4287-a6b0-92164038d5bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Nov 24 18:26:18.659558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 653/1309] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:19.670124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:19.671290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:19.678569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:19.679023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:19.679805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:19.680239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:19.710172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f80dcc9e-ca86-4700-a101-1f629b98cb9a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Nov 24 18:26:19.710719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 657/1310] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:20.721859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:20.722778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:20.728846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:20.729295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:20.730103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:20.730538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:20.759899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5de94995-e1d4-416f-86e5-834d39f9fa90 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Nov 24 18:26:20.760453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 654/1311] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:21.771085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:21.772007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:21.778185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:21.778636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:21.779413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:21.779847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:21.809431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9e5d0e63-0c55-496e-a032-2ad18638ac99 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Nov 24 18:26:21.809998 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 658/1312] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:22.820117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:22.821032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:22.827195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:22.827645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:22.828468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:22.829545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:22.859529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d80718f7-f421-4194-aabe-7008ff1f1808 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Nov 24 18:26:22.860128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 655/1313] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:23.870445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:23.871352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:23.878617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:23.879066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:23.879844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:23.880282 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:23.909609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7962addb-cbb3-4e20-8835-1300bb5f8d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Nov 24 18:26:23.910184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 659/1314] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:24.920483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:24.921665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:24.928514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:24.928969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:24.929754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:24.930219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:24.958919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-993de612-0dd3-4233-a1db-1566ea967076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Nov 24 18:26:24.959406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 656/1315] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:25.970745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:25.971669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:25.977789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:25.982390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:25.982390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:25.982390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:26.009601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fb05d558-71a9-43c4-84da-53707f269374 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Nov 24 18:26:26.013430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 660/1316] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:27.021107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:27.022066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:27.028356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:27.028813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:27.029598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:27.030147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:27.060745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-52121deb-0d70-48fb-b3ae-ceb6dd43c631 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Nov 24 18:26:27.061304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 657/1317] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:28.072076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:28.073022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:28.079945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:28.080337 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:28.081105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:28.081548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:28.110707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3b7ad4bf-4a67-4d38-a27e-55396a401bc3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Nov 24 18:26:28.111168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 661/1318] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:29.121888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:29.122799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:29.129616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:29.130144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:29.131007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:29.131330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:29.160183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3b63f6cb-77d2-41a7-92d0-66f84993e5fa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Nov 24 18:26:29.160724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 658/1319] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:30.171511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:30.172445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:30.180155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:30.180155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:30.180465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:30.180897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:30.211526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7df38e4d-2baf-4fb4-b139-fc3dc58d2d43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 Nov 24 18:26:30.212011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 662/1320] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:31.222002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:31.222922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:31.229000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:31.229463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:31.230376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:31.230819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:31.260550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c6485b1e-66e2-45c9-b08b-9cc05b90b583 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042091 Nov 24 18:26:31.261247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 659/1321] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:32.271804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:32.272715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:32.278897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:32.279339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:32.280105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:32.280535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:32.310404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9515fad9-6998-4a79-86a7-087ee6338169 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Nov 24 18:26:32.311072 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 663/1322] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:33.322781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:33.323928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:33.330223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:33.330717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:33.331632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:33.332131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:33.362414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-562fc678-2f19-48e0-86df-0848bd5c4111 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042553 Nov 24 18:26:33.362979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 660/1323] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:34.373672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:34.374630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:34.381456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:34.381931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:34.382701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:34.383129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:34.412076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7b25e12f-6a37-45f7-a0f3-52d676ac144d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Nov 24 18:26:34.412619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 664/1324] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:35.423071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:35.424687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:35.430946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:35.431399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:35.432156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:35.432587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:35.461507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-50dce2cc-02fe-449d-b8a8-7acd74764df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 Nov 24 18:26:35.462083 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 661/1325] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:36.472084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:36.472996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:36.479874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:36.480331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:36.481120 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:36.481559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:36.511164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-23d6b5bb-065d-43ed-9945-a2afd4310694 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Nov 24 18:26:36.511729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 665/1326] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:37.522859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:37.523896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:37.530085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:37.530541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:37.531319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:37.531756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:37.561748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ea8cfa1a-632e-40dd-84a1-733d29561228 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Nov 24 18:26:37.562345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 662/1327] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:38.572343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:38.573338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:38.579450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:38.579903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:38.581279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:38.581717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:38.611050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5fb8ad01-d1f6-4fe8-b7fc-ffcdb44285f2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Nov 24 18:26:38.611872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 666/1328] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:39.622532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:39.623438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:39.629750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:39.630215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:39.631146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:39.631779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:39.663103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d336d3bd-90b0-4169-9bac-71f952852caf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Nov 24 18:26:39.663660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 663/1329] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:40.674304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:40.675302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:40.681877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:40.682512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:40.683333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:40.683838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:40.713437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4b4c36a2-59dc-41d5-9436-4c2d5b76ae55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Nov 24 18:26:40.714021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 667/1330] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:41.724399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:41.725323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:41.731346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:41.731800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:41.732682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:41.733005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:41.762504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-daae40c1-5934-4575-b354-6c562f614c28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Nov 24 18:26:41.763062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 664/1331] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:42.774955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:42.775977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:42.782207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:42.782659 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:42.783440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:42.783882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:42.813468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c3fb0885-e2a3-47e4-8f57-1a56ff322943 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 Nov 24 18:26:42.814003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 668/1332] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:43.824962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:43.825702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:43.832600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:43.833341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:43.834189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:43.834627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:43.869548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1aa08848-96d1-4370-83db-f4ac166cf25f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Nov 24 18:26:43.870167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 665/1333] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:44.882107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:44.883027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:44.889134 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:44.889583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:44.890406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:44.890845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:44.920119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d5b40de-c000-407f-92bb-a45152c15624 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Nov 24 18:26:44.920931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 669/1334] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:45.934411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:45.934411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:45.940086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:45.940532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:45.941311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:45.941749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:45.971814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f268b1c9-6966-4fee-9bc4-757412c53c2d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Nov 24 18:26:45.972365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 666/1335] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:46.983866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:46.984863 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:46.992483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:46.992943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:46.993728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:46.994187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:47.023163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-00ce30e2-6992-43d1-a4ef-aca92c591e5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Nov 24 18:26:47.023714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 670/1336] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:48.037823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:48.038744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:48.044947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:48.045399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:48.046467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:48.046913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:48.077007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8fcbe3f7-b1e5-4d77-a485-e2a7a8b4706b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Nov 24 18:26:48.077563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 667/1337] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:49.088535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:49.089453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:49.095389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:49.095838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:49.096608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:49.097043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:49.125470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5b5143a0-9115-441c-bee5-f2dc137e1490 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041156 Nov 24 18:26:49.126050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 671/1338] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:50.136389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:50.137296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:50.143117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:50.143561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:50.144325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:50.144755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:50.176577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10bdfa50-bbbb-4986-969f-67a94cc6c602 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Nov 24 18:26:50.177137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 668/1339] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:51.188226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:51.189144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:51.195933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:51.196388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:51.197166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:51.197608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:51.226828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f44191e5-8e1b-43d9-a518-2eef64074397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042422 Nov 24 18:26:51.227380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 672/1340] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:52.237923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:52.238837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:52.245965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:52.246417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:52.247195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:52.247628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:52.278189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-80359019-af97-416e-ad1e-e0a060de5578 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Nov 24 18:26:52.278744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 669/1341] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:53.289251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:53.290321 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:53.296496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:53.296961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:53.297697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:53.298161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:53.328014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d8a10e25-6b38-424c-adee-dc0591394a7d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Nov 24 18:26:53.328559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 673/1342] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:54.339366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:54.340802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:54.347219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:54.347662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:54.348430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:54.348860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:54.379930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e113f533-6f86-4787-b817-15d02b08d229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Nov 24 18:26:54.380487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 670/1343] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:55.391934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:55.392908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:55.399738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:55.400136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:55.400912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:55.401345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:55.430607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-40e90f11-1382-4f39-94e5-a68bb5bf8105 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 Nov 24 18:26:55.431161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 674/1344] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:56.441526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:56.442478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:56.449318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:56.449781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:56.450579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:56.451020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:56.481149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bfe05879-a29f-48a8-b857-ef1b1a133994 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Nov 24 18:26:56.481711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 671/1345] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:57.492248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:57.493157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:57.499267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:57.499710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:57.500477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:57.500905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:57.530282 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-79bceae0-0cbe-43c8-99c6-61c91ca797c1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Nov 24 18:26:57.530828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 675/1346] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:58.541841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:58.542799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:58.549309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:58.549754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:58.550580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:58.551013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:58.582517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-58173313-89df-46af-980b-e481fb3e1ce2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Nov 24 18:26:58.583067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 672/1347] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:59.593601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:59.594633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:26:59.600584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:59.601787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:59.602588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:26:59.603015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:26:59.632187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c05b52a0-dc18-4a3a-93d8-8d1d4853d03d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Nov 24 18:26:59.632935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 676/1348] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:26:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:00.643733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:00.644787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:00.651153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:00.651782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:00.652371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:00.652808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:00.681980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-37e9d314-9603-44b5-8e77-7d4b8be55ba8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Nov 24 18:27:00.682535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 673/1349] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:01.692300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:01.693209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:01.700278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:01.700722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:01.701502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:01.701965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:01.731544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e4f01fb7-b455-4f63-9c85-17218c1e4c4e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Nov 24 18:27:01.732091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 677/1350] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:02.742644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:02.743569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:02.750014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:02.750464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:02.751247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:02.751683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:02.781669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b2b36d13-d43b-4a28-91f2-6b9b493dd780 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Nov 24 18:27:02.782487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 674/1351] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:03.799716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:03.799716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:03.801345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:03.801827 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:03.802612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:03.803047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:03.832875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4ba9e392-2853-466a-a5d6-3bff5b59a65e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Nov 24 18:27:03.833442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 678/1352] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:04.844307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:04.845146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:04.851384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:04.851830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:04.852602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:04.853038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:04.881350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08d04a03-5a5d-4567-95d2-e042911c071c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Nov 24 18:27:04.881931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 675/1353] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:05.893885 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:05.894820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:05.900956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:05.904697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:05.904697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:05.904697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:06.087588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ba896890-e3ae-4e1e-81f5-3a20a7bfd4df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197442 Nov 24 18:27:06.092049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 679/1354] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:07.099000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:07.099856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:07.106714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:07.107166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:07.107936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:07.108414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:07.136691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a4147e86-ea4a-4187-b94d-458175ee8516 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Nov 24 18:27:07.137288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 676/1355] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:08.147878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:08.148705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:08.155136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:08.155601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:08.156375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:08.156812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:08.185924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0c91447b-dbe5-4502-8b2c-5ab220e68609 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Nov 24 18:27:08.186461 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 680/1356] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:09.197879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:09.198703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:09.204862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:09.205303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:09.206292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:09.207037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:09.235359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c304174a-3a50-4cec-a775-93ff29b2a763 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Nov 24 18:27:09.235900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 677/1357] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:09.524651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:09.525178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:27:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:10.246708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:10.247560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:10.253360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:10.253843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:10.254619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:10.255058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:10.283878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-264f9805-1a28-4f2d-afeb-d99488ee7084 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 Nov 24 18:27:10.284406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 681/1358] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:10.370161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:10.370634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:27:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:11.295022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:11.296207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:11.302119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:11.302571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:11.303341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:11.304298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:11.332750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-272caffd-bbf9-4cd4-85d5-7e6af3c78858 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Nov 24 18:27:11.333231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 678/1359] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:12.343241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:12.344094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:12.350332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:12.350984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:12.351764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:12.352201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:12.380693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-162a08d0-5c4b-4bd3-990b-251b24f7f2d5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Nov 24 18:27:12.381244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 682/1360] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:13.392304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:13.394897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:13.399617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:13.400061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:13.400823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:13.401252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:13.430987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8e3ac910-4db7-4fcf-9e5d-fcad3ce2ef1a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 Nov 24 18:27:13.431541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 679/1361] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:14.442026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:14.442945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:14.449201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:14.449652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:14.450460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:14.450897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:14.480078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-62215704-5e99-4d71-8964-86918d734935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Nov 24 18:27:14.480630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 683/1362] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:15.490390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:15.491513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:15.497632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:15.498113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:15.498882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:15.499361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:15.529163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e95dd73d-7419-49f4-bd60-c9ebb5ad2807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Nov 24 18:27:15.529731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 680/1363] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:16.540906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:16.541859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:16.548391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:16.548841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:16.549613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:16.550093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:16.579930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-36c1e9b9-4f77-48d0-8793-d7662ca98fea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043275 Nov 24 18:27:16.580413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 684/1364] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:17.591142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:17.592055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:17.598283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:17.598731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:17.599501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:17.599932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:17.630632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6cdb27fe-36ce-49fb-8217-11875665c8e7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Nov 24 18:27:17.631189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 681/1365] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:18.641982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:18.642891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:18.649179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:18.649625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:18.650427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:18.650858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:18.681785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-38115306-0dc7-4532-875b-c1ba4df0bd4d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Nov 24 18:27:18.682356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 685/1366] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:19.692983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:19.693939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:19.700763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:19.702286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:19.703110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:19.703561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:19.733294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d35471a1-d77c-4939-8f31-5ad36318098c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Nov 24 18:27:19.733877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 682/1367] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:20.744787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:20.745697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:20.752112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:20.752566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:20.753339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:20.753798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:20.782572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8a976b72-3e2d-4f82-83ba-e95ba1ab5a0d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Nov 24 18:27:20.783311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 686/1368] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:21.794015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:21.794931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:21.801999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:21.802452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:21.803237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:21.803679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:21.841435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-54615988-d1d9-4f04-b644-26b0bc728f1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Nov 24 18:27:21.841435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 683/1369] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:27:22.845644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:22.846520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:22.853951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:22.854403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:22.855185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:22.855622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:22.886331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d5b3357a-3b6c-43d6-be26-43248fc621a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Nov 24 18:27:22.890030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 687/1370] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:23.897253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:23.899308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:23.905477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:23.905966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:23.906743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:23.907179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:23.938160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-db57da2b-fbc5-4e14-9ad5-6b0d81e7aaf0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Nov 24 18:27:23.938723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 684/1371] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:24.949082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:24.950032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:24.956160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:24.956608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:24.957383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:24.957838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:24.989227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-97890703-1489-4ea1-9350-0b0b9db39229 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Nov 24 18:27:24.989797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 688/1372] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:26.001087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:26.002020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:26.008915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:26.009357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:26.010190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:26.010625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:26.040641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c9e33d6-7ddd-4630-b3c6-c9a720631103 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 Nov 24 18:27:26.045647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 685/1373] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:27.053969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:27.054891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:27.061417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:27.061904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:27.062684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:27.063126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:27.092991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8104f939-2121-4a67-8fd5-2fdd5d775a37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042728 Nov 24 18:27:27.093548 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 689/1374] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:28.105181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:28.106213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:28.112381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:28.112828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:28.113599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:28.114062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:28.144649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42d799ba-e2a8-460f-8e41-37fc21e7e8f6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Nov 24 18:27:28.145205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 686/1375] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:29.155789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:29.156818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:29.162936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:29.163583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:29.164159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:29.165308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:29.194315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-96ee1a54-b22f-4bf4-b4e4-be700f734205 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042258 Nov 24 18:27:29.194868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 690/1376] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:30.205391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:30.207684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:30.213446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:30.213930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:30.214715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:30.215150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:30.245483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d24cd209-c107-4b86-98d7-d3aa21a214da tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Nov 24 18:27:30.249261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 687/1377] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:30.507694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:30.507871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:27:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:31.255950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:31.256882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:31.263768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:31.264208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:31.264976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:31.265404 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:31.298356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7300069a-c3e7-471c-9cb2-dfa1276cec29 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Nov 24 18:27:31.298356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 691/1378] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:32.309955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:32.310879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:32.317093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:32.317547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:32.318354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:32.318949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:32.347938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e50131f8-17be-40c3-bec9-56b684613354 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Nov 24 18:27:32.348485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 688/1379] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:33.358646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:33.359661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:33.366073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:33.366519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:33.367294 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:33.368212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:33.397482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0bbc7f2b-2533-447f-9a23-4eb3488b126f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042480 Nov 24 18:27:33.398128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 692/1380] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:34.410553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:34.411473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:34.417781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:34.418241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:34.419026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:34.419470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:34.449958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7dc9cd6c-5ceb-40ff-b181-db6f137a8691 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 Nov 24 18:27:34.450504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 689/1381] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:35.027265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:35.027454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:27:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:35.460207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:35.461160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:35.467949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:35.468399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:35.469250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:35.469687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:35.499694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ff006e47-b4be-40be-a9a2-ab5729e7ad93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Nov 24 18:27:35.500232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 693/1382] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:36.511275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:36.512476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:36.518790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:36.519242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:36.520030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:36.520465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:36.550244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c561e3e9-2351-4cc0-90d7-8a46feac81f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Nov 24 18:27:36.550727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 690/1383] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:37.050343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:37.050915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:27:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:37.562337 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:37.563243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:37.569488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:37.569970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:37.571423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:37.571963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:37.599945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cdf814c2-6248-4455-8907-b7ef0a9ae6b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Nov 24 18:27:37.600476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 694/1384] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:38.611126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:38.612070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:38.618523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:38.618964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:38.619734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:38.620193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:38.648497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e810f704-4b38-40d2-affb-b54ba66b6938 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 Nov 24 18:27:38.649874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 691/1385] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:39.660257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:39.661196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:39.668301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:39.668753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:39.669528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:39.670265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:39.698398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b8a1cb48-6093-4023-90b8-ca5c737efc7e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Nov 24 18:27:39.698949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 695/1386] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:40.709485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:40.710436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:40.717478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:40.717968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:40.718736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:40.719171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:40.747865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-abd2c0c0-2027-4783-94eb-ff560727330c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Nov 24 18:27:40.748340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 692/1387] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:41.759153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:41.760061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:41.766036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:41.766483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:41.767251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:41.767683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:41.797035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-62886a0a-3d94-4658-a7a3-b191731b7ca2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Nov 24 18:27:41.797573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 696/1388] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:42.808331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:42.809167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:42.815405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:42.815853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:42.816622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:42.817059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:42.846023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab6895b1-8684-4215-8f64-ba61fafbe9ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Nov 24 18:27:42.846569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 693/1389] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:43.856222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:43.857132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:43.863299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:43.863743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:43.864511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:43.864945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:43.894466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-655933d4-52a0-484f-b8d6-42fb624c314e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 Nov 24 18:27:43.894992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 697/1390] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:44.905508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:44.906441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:44.912583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:44.913035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:44.913833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:44.914305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:44.944184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-277cb4bc-d44e-4462-88d6-06d65b9b055a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Nov 24 18:27:44.944741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 694/1391] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:45.955732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:45.960367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:45.964149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:45.964596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:45.965557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:45.966329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:45.998725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ad57097b-9d5e-40bd-8893-4858531200bd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Nov 24 18:27:45.999291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 698/1392] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:47.009671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:47.010623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:47.016507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:47.016952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:47.017731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:47.018199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:47.046520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d5107f74-b39b-47aa-9943-2a1810aac944 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Nov 24 18:27:47.047073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 695/1393] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:48.057670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:48.058636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:48.064728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:48.065175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:48.065974 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:48.066412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:48.095289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-415f9fbe-b4e6-4471-a47b-831a72ffa407 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Nov 24 18:27:48.095821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 699/1394] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:49.106909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:49.107821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:49.113983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:49.114435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:49.115205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:49.115640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:49.144759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d8a95591-0f22-42ae-bc14-da388f2ecb83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Nov 24 18:27:49.145304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 696/1395] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:50.155835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:50.156752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:50.162939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:50.163391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:50.164166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:50.164603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:50.193161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-30336eb3-79c7-4e4a-b512-d674639db28f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Nov 24 18:27:50.193693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 700/1396] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:51.204651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:51.205563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:51.212512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:51.212964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:51.213744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:51.214206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:51.242574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9770675-7930-463e-9d6b-420bdf1ac3b7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Nov 24 18:27:51.243747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 697/1397] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:52.253779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:52.254726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:52.261006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:52.261453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:52.262252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:52.262683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:52.292128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-afe9e642-273b-4079-8119-fc0436edd5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Nov 24 18:27:52.292660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 701/1398] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:53.303552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:53.304458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:53.311637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:53.312081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:53.312851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:53.313285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:53.342301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-432cd3c5-567e-40bb-b376-576ed46c51a2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 Nov 24 18:27:53.343087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 698/1399] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:54.352976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:54.353850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:54.360160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:54.360609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:54.361382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:54.361839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:54.390554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-261b10f1-9f2e-489e-8a2d-1f11fc8e3bf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 Nov 24 18:27:54.391097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 702/1400] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:55.403115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:55.404063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:55.410368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:55.410819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:55.411590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:55.412024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:55.442082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b6f7ecfc-6d62-48cf-aeba-4a6b5bd14138 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Nov 24 18:27:55.442624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 699/1401] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:27:56.452883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:56.453813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:56.459969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:56.460417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:56.461183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:56.461614 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:56.490162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2492bc1a-8109-4a8a-b36d-589ec23bcc9e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Nov 24 18:27:56.490700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 703/1402] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:27:57.501356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:57.502305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:57.508467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:57.508917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:57.509710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:57.510172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:57.538439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d9356e5b-1ec4-45ae-9237-7a4137759bf6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 Nov 24 18:27:57.538986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 700/1403] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:58.550579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:58.551516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:58.558797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:58.559244 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:58.560026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:58.560457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:58.590125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-20fbaa9b-9381-40ac-8ee3-ac2e00fab4e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Nov 24 18:27:58.590669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 704/1404] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:59.601084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:59.602030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:27:59.609416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:59.609896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:59.610676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:27:59.611116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:27:59.639688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78cf2ad2-abf6-4aee-88df-657f6673f2cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Nov 24 18:27:59.640244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 701/1405] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:27:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:00.651710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:00.652625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:00.658804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:00.659277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:00.660046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:00.660485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:00.690291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-554f96f7-a255-44a8-b545-eff31d91b9c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Nov 24 18:28:00.690828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 705/1406] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:01.701850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:01.702796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:01.709033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:01.709485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:01.710298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:01.710744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:01.739595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-12546f3c-be09-43c1-b71b-17a2feeb9736 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Nov 24 18:28:01.740149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 702/1407] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:02.750713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:02.751619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:02.757717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:02.758212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:02.758971 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:02.760014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:02.787528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d5c70e55-6a08-48c5-84ad-85d8fdda4b24 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040481 Nov 24 18:28:02.788058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 706/1408] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:03.799323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:03.800235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:03.806981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:03.807437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:03.808272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:03.808652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:03.836883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9fb396de-8773-4942-8991-ddb5e62ebc1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Nov 24 18:28:03.837995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 703/1409] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:04.848907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:04.849739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:04.856467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:04.856908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:04.857680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:04.858149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:04.887026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-268134b1-f103-4089-9b9c-13083cf4cb46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Nov 24 18:28:04.897288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 707/1410] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:05.897367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:05.898377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:05.905741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:05.906221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:05.906992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:05.907425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:05.937581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-43ee6224-63aa-4291-bda2-5112436dac64 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Nov 24 18:28:05.938187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 704/1411] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:06.949657 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:06.950604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:06.956853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:06.957300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:06.958105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:06.958541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:06.991125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3b9a2d77-bee6-47c2-833f-b081ed34843e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Nov 24 18:28:06.991697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 708/1412] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:08.002567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:08.003481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:08.009710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:08.010252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:08.011035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:08.011472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:08.041255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3dca61eb-40a0-4ef4-b322-8042d5bddddc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Nov 24 18:28:08.042058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 705/1413] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:09.052773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:09.053685 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:09.060477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:09.060926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:09.061695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:09.062152 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:09.090506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b5ede712-dc2d-482a-adf0-d394b9e988cf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041429 Nov 24 18:28:09.091040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 709/1414] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:10.101689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:10.102627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:10.109086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:10.109535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:10.110337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:10.110774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:10.139940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-62475a20-493e-4ef0-ac00-3b79a22ec7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Nov 24 18:28:10.140511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 706/1415] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:11.150784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:11.151818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:11.157905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:11.158357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:11.159132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:11.159571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:11.188610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3d1baecc-fbbf-4b8a-b738-b2390616564b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Nov 24 18:28:11.189164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 710/1416] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:12.200750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:12.201718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:12.207942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:12.208393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:12.209201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:12.209644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:12.238433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4bd9d7c3-3f70-4349-8597-1f0c881acb5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Nov 24 18:28:12.238987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 707/1417] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:13.248806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:13.249717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:13.255888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:13.256334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:13.257099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:13.257529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:13.285717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7ae124f9-1475-4c8b-b02f-fd745e69b1e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Nov 24 18:28:13.286286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 711/1418] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:14.297214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:14.298146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:14.304628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:14.305396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:14.306891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:14.307428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:14.336073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2765479f-fddf-46bb-8e68-cbde8e29f0b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Nov 24 18:28:14.336620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 708/1419] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:15.347497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:15.348444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:15.355892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:15.356345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:15.357188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:15.357652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:15.387909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c2299165-c53d-45dd-bc89-126a46c0b01c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Nov 24 18:28:15.388457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 712/1420] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:16.399047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:16.400082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:16.406427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:16.406869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:16.407633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:16.408063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:16.437311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5bcd0cd9-9992-49da-8b94-8b988dc99271 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 Nov 24 18:28:16.437938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 709/1421] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:17.449073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:17.450008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:17.456155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:17.456597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:17.457353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:17.457839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:17.486540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4ab10284-ef7a-4b81-9be0-7d6905d0e267 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041776 Nov 24 18:28:17.487076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 713/1422] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:18.498391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:18.499304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:18.505509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:18.505998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:18.506801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:18.507241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:18.536301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4e99c1c3-ebb0-41d0-ba62-7c74e59caf86 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Nov 24 18:28:18.536856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 710/1423] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:19.552999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:19.553945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:19.560552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:19.561002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:19.561811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:19.562241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:19.591409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cc940ef1-9bc8-4e30-9b72-c92100e0dbb5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Nov 24 18:28:19.591955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 714/1424] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:20.602575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:20.604353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:20.610500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:20.610937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:20.611694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:20.612119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:20.640959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d1a82f0-b458-4906-801a-624bc80ba48d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 Nov 24 18:28:20.641503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 711/1425] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:21.651890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:21.652811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:21.659017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:21.659469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:21.660277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:21.660710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:21.689309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ed551ea-595b-47ad-9549-961d263a5770 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041204 Nov 24 18:28:21.689868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 715/1426] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:22.700301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:22.701209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:22.707398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:22.707851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:22.708633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:22.709067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:22.737869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1d028d89-eca8-48aa-8b4d-c4c7ff1ebaf8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Nov 24 18:28:22.738426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 712/1427] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:23.749434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:23.750366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:23.756490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:23.756930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:23.757688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:23.758140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:23.786349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ac53b173-562d-4165-a682-138f14bebb15 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040615 Nov 24 18:28:23.786880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 716/1428] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:28:24.797821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:24.798731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:24.805003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:24.815649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:24.815649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:24.815649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:24.835197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-30e6ca5c-a3ce-4f8b-b0ae-76dc93b3dff5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Nov 24 18:28:24.835752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 713/1429] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:25.846973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:25.847898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:25.854642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:25.855095 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:25.855879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:25.856317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:25.886557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-00450d8f-58b8-4c00-abda-ddf9ba6950b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Nov 24 18:28:25.887107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 717/1430] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:26.898006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:26.899267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:26.906036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:26.906489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:26.907289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:26.907740 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:26.937266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-075bf580-77aa-4e81-b663-49188f338fc0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043163 Nov 24 18:28:26.937836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 714/1431] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:27.948717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:27.949633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:27.955853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:27.956301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:27.957072 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:27.957506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:27.986375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3c0cc1ea-3106-4c74-8eb1-f2f773424df6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Nov 24 18:28:27.986923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 718/1432] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:28.996900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:28.997865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:29.004033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:29.004487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:29.005260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:29.005899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:29.034586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-31cb2fd6-837b-41bd-a3cf-a7df94929f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Nov 24 18:28:29.035134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 715/1433] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:30.046011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:30.046918 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:30.053014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:30.053457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:30.054251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:30.054695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:30.083547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e7e11cb8-56a4-429b-aea5-f6406d679520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Nov 24 18:28:30.084105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 719/1434] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:31.094762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:31.095815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:31.102152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:31.103201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:31.103986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:31.104423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:31.133047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-291bd327-5d63-45fd-9a55-b0dc0dd868e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 Nov 24 18:28:31.133590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 716/1435] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:32.144189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:32.145097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:32.151990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:32.152431 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:32.153197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:32.153622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:32.183036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ef92f2a8-40cd-43d9-8d3b-7d3eda184935 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Nov 24 18:28:32.183580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 720/1436] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:33.193560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:33.194631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:33.201468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:33.201959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:33.202748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:33.203190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:33.232498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-885c11d9-fbc3-471c-b0c7-65c0fe011815 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Nov 24 18:28:33.233052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 717/1437] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:34.243684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:34.244601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:34.250835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:34.251285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:34.252050 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:34.252488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:34.281196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b851f00c-0079-465d-8970-bb427f7fb0e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Nov 24 18:28:34.281742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 721/1438] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:35.292476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:35.293382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:35.299843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:35.300294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:35.301057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:35.301488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:35.331298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6bec567a-04d6-427e-9a70-49e45546b983 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Nov 24 18:28:35.331858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 718/1439] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:36.343215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:36.344214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:36.350387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:36.350832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:36.351606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:36.352043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:36.379893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e0c97f1f-82c2-4082-9a39-0b8f9a185435 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 Nov 24 18:28:36.380436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 722/1440] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:37.391353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.392280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:37.398946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:37.399944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:37.400816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:37.401247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:37.430302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1a53d0f-59d7-4fec-b62e-7f8c9b5e925a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Nov 24 18:28:37.430998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 719/1441] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:38.441625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:38.442566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:38.448747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:38.449194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:38.450026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:38.450459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:38.478967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-74db9145-953c-4fb1-86c2-18969dc15f8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 Nov 24 18:28:38.479533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 723/1442] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:39.490073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:39.491012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:39.497836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:39.498293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:39.499097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:39.499531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:39.528278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e9f8803f-92f7-405b-abc5-3f23c54d4e51 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Nov 24 18:28:39.528829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 720/1443] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:40.538731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:40.539772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:40.546482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:40.546931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:40.547703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:40.548135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:40.576795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-824bb1ae-5f30-481e-8f3e-bf962700ee4c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041810 Nov 24 18:28:40.577342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 724/1444] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:41.588786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:41.589709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:41.595464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:41.595918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:41.596731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:41.597171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:41.625658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4960c1ee-9e61-49d2-91c7-c0c5927f6b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Nov 24 18:28:41.626243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 721/1445] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:42.636164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:42.637099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:42.643299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:42.643743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:42.644504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:42.644932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:42.675524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6c06c0c5-be00-450d-bcba-8f9580a8b563 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Nov 24 18:28:42.676067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 725/1446] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:43.686814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:43.687735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:43.693961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:43.694423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:43.695207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:43.695647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:43.725864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-114e5986-3176-4d17-aa32-f91d71913fda tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Nov 24 18:28:43.726420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 722/1447] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:44.736284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:44.744065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:44.744514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:44.744687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:44.745463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:44.745922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:44.776364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e258714e-d716-429f-b6c6-3ca0aac8a54d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Nov 24 18:28:44.776924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 726/1448] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:45.787835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:45.788762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:45.801550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:45.801550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:45.801550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:45.801550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:45.826713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7208d938-b0f5-453f-99c9-230e5b58fde5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Nov 24 18:28:45.827182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 723/1449] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:46.838312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:46.839222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:46.845305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:46.845741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:46.846536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:46.846965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:46.875395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5919c8d7-fd88-4e1b-8422-94e6e743fe97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041416 Nov 24 18:28:46.875929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 727/1450] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:47.888802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:47.889736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:47.896172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:47.896623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:47.897416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:47.897891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:47.929043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5fecac23-b807-4b2b-a47e-e2fbc5291f88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Nov 24 18:28:47.929615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 724/1451] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:48.940181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:48.941101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:48.948111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:48.948565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:48.949352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:48.950084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:48.979238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-91f1061a-a2ae-4c12-8705-cae116cebbec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Nov 24 18:28:48.979787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 728/1452] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:49.990496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:49.991236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:49.998068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:49.998521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:49.999304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:49.999741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:50.031945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-640a986b-b49e-455f-ae33-0abdb4caf349 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 Nov 24 18:28:50.032513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 725/1453] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:51.043180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:51.044350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:51.050463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:51.050919 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:51.051697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:51.052135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:51.082179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6adfc51-c12a-447d-9f6f-422b4d25f3cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Nov 24 18:28:51.082725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 729/1454] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:52.093484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:52.094546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:52.100796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:52.101252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:52.102096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:52.103140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:52.132552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7ff72183-070b-4d28-a2a4-5741369e9e1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Nov 24 18:28:52.133109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 726/1455] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:53.143880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:53.144793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:53.151612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:53.152056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:53.152830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:53.153260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:53.184255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f222133c-3010-49fd-86b6-3e4e736d6140 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Nov 24 18:28:53.184813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 730/1456] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:54.195574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:54.196587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:54.202714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:54.203155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:54.203920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:54.204351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:54.233226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-109609a1-0ac3-4ef8-897d-931a95e9b508 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Nov 24 18:28:54.233780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 727/1457] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:55.244800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:55.245735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:55.251897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:55.252341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:55.253103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:55.253536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:55.282829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d9f88b3-83ca-45e8-8f35-1c14ceec5c77 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Nov 24 18:28:55.283361 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 731/1458] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:56.294175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:56.295102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:56.301237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:56.301679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:56.302473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:56.302898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:56.332750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-68118841-20f8-445f-8f6b-0f589501102d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Nov 24 18:28:56.333298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 728/1459] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:57.343783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:57.344693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:57.350923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:57.351362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:57.352642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:57.353262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:57.383409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ba857f23-a034-43f8-8493-6a9a741bc6e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Nov 24 18:28:57.384086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 732/1460] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:58.398370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:58.398370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:58.403159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:58.403606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:58.404416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:58.404849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:58.434916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fa9cfa0e-862a-477d-9eb9-9750bb2f64e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Nov 24 18:28:58.435494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 729/1461] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:59.447075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:59.448076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:28:59.454707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:59.455159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:59.455949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:28:59.456389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:28:59.486202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-afd98b31-b066-47b4-bb87-a7c9987197d1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Nov 24 18:28:59.486752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 733/1462] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:28:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:00.505737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:00.506676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:00.513708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:00.514202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:00.514981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:00.515416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:00.547595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f90a7d91-6786-4f53-8894-78017b10b127 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Nov 24 18:29:00.548150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 730/1463] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:01.566884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:01.567820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:01.574331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:01.574784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:01.575564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:01.575998 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:01.605459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-719ee9db-eb85-4b5b-aecb-7064a7376c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050485 Nov 24 18:29:01.606042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 734/1464] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:02.616131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:02.617127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:02.624375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:02.624828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:02.625614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:02.626081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:02.656840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8f94a32-fef3-4b84-a057-a61be14d1967 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Nov 24 18:29:02.657397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 731/1465] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:03.669114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:03.670058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:03.676248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:03.676709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:03.677499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:03.677950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:03.707755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-edfd06c0-5d66-4f95-a799-6517f0735ba1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Nov 24 18:29:03.708308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 735/1466] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:04.720214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:04.721143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:04.727872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:04.728342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:04.729126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:04.729566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:04.759408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8d939486-ffc0-4146-9c04-f10ec776b247 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Nov 24 18:29:04.759971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 732/1467] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:05.772042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:05.772963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:05.780578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:05.781066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:05.781872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:05.782373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:05.813288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-72733564-4178-4c0a-b2a7-0883ceed2679 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Nov 24 18:29:05.813786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 736/1468] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:06.824446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:06.825352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:06.831745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:06.832192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:06.832967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:06.833399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:06.863589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1f4f684f-ee28-4abe-aa0f-290c0dcd49ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Nov 24 18:29:06.864136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 733/1469] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:07.205180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:29:07.205742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:29:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:29:07.875236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:07.879751 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:07.882318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:07.882759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:07.884236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:07.884666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:07.913445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-207e05be-7e02-4aed-b33c-091854e1831a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Nov 24 18:29:07.914037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 737/1470] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:08.924653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:08.925567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:08.931906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:08.932363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:08.933150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:08.933589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:08.962637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-76fe7e95-64fe-4af6-a657-25c371032782 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Nov 24 18:29:08.963199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 734/1471] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:09.973870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:09.974791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:09.981537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:09.982027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:09.982812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:09.983246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:10.012366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-83d21d8a-3be6-4232-8240-c8558181bec3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Nov 24 18:29:10.012910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 738/1472] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:11.023396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:11.025014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:11.031355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:11.031815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:11.032599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:11.033036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:11.063147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f01de3b-bf6e-4113-9420-b54047a739d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Nov 24 18:29:11.063701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 735/1473] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:12.073726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:12.074670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:12.080799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:12.081240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:12.082028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:12.082457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:12.112188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ca379ed1-64aa-49f6-a2a5-cc8295cd1cbe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Nov 24 18:29:12.112728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 739/1474] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:13.123307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:13.124218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:13.130444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:13.130903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:13.131686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:13.132126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:13.162658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a77112d-8a9f-4100-99e5-823ab101c134 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Nov 24 18:29:13.163220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 736/1475] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:14.174123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:14.175056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:14.182199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:14.182642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:14.183409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:14.183838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:14.212831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4b4d0eb5-22a1-4d54-9f40-a1270958a29b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Nov 24 18:29:14.213362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 740/1476] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:15.227270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:15.228181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:15.234317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:15.234766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:15.235536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:15.235966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:15.265148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fbe36fd4-524f-4a05-9e31-60af301c4772 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 Nov 24 18:29:15.265694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 737/1477] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:16.276766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:16.277685 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:16.283982 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:16.284439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:16.285216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:16.285654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:16.315853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d15ce7b8-407c-43f7-a7d9-03d1568be443 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Nov 24 18:29:16.316395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 741/1478] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:17.327326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:17.328251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:17.334481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:17.334932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:17.335706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:17.336189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:17.365404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c1bba265-e671-483c-8ec1-e380850fe5fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Nov 24 18:29:17.366013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 738/1479] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:18.377079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:18.378032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:18.384771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:18.385215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:18.386015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:18.386451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:18.415495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fa479727-411b-48d0-b873-3250c474962c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Nov 24 18:29:18.416031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 742/1480] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:19.426820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:19.427728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:19.434192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:19.434634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:19.435405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:19.435832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:19.465179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0218c303-86fd-4029-a619-4d7cf28b010f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 Nov 24 18:29:19.465724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 739/1481] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:20.476229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:20.477669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:20.483573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:20.484022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:20.484806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:20.485241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:20.514912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-853b6e0f-f87c-4759-97a7-2527c70ae261 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042488 Nov 24 18:29:20.515459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 743/1482] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:21.526938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:21.527933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:21.534321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:21.534778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:21.535557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:21.535998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:21.576006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-15f9d600-1f6b-4f3f-ae36-0c1bd82456bb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053751 Nov 24 18:29:21.576571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 740/1483] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:22.587613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:22.588532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:22.594452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:22.594902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:22.595675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:22.596110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:22.627772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5a406170-be0a-461e-9616-0dbd1719ecd2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Nov 24 18:29:22.628319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 744/1484] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:23.639570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:23.640595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:23.647129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:23.647718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:23.649646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:23.649646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:23.686901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-824924b6-6974-4409-98cc-a9f555b13fe9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050941 Nov 24 18:29:23.687477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 741/1485] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:24.698230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:24.699159 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:24.705185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:24.705626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:24.706436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:24.706863 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:24.737440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7e9733e2-72fe-414c-bb9d-48fc01b8542d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Nov 24 18:29:24.737994 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 745/1486] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:25.749133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:25.750192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:25.756584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:25.757040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:25.758129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:25.758686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:25.790035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e3b49717-92d1-449b-9d32-e552ab49360f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Nov 24 18:29:25.790898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 742/1487] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:26.801437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:26.804679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:26.811509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:26.811898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:26.812681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:26.813123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:26.843432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-529d75d3-a2eb-483f-92a1-d39cadddab3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Nov 24 18:29:26.844175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 746/1488] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:27.854854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:27.855745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:27.863692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:27.864168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:27.864943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:27.865403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:27.894726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9c0c3ad0-ec89-4b25-95e9-30da60c66f8f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Nov 24 18:29:27.895288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 743/1489] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:28.906460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:28.908781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:28.913975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:28.914427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:28.915209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:28.915646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:28.945723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bda27a5b-acfe-4d9f-bc13-03d756f5173e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 Nov 24 18:29:28.946303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 747/1490] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:29.957384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:29.958940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:29.965748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:29.966226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:29.967017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:29.967454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:29.997069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4142a4c1-3d43-40e3-94b3-11aa443b1167 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Nov 24 18:29:29.997623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 744/1491] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:31.008018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:31.009104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:31.015725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:31.016169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:31.016933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:31.017361 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:31.046615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-079c5aae-bca8-4c7a-9423-30f3753d6ff1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Nov 24 18:29:31.047148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 748/1492] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:32.058088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:32.059183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:32.065312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:32.065793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:32.066556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:32.066987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:32.096410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-24e5ef26-43bc-4dad-8267-9f0977b4e699 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Nov 24 18:29:32.096965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 745/1493] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:33.107459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:33.108376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:33.114602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:33.115054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:33.115832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:33.116340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:33.145180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-af09be73-4b5d-4efa-a785-9fd99725e9a1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Nov 24 18:29:33.145707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 749/1494] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:34.156709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:34.157629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:34.163966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:34.164409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:34.165185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:34.165616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:34.194975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-188bf135-3701-407f-9528-86ac48eccb5d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 Nov 24 18:29:34.195523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 746/1495] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:35.206680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:35.207661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:35.214066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:35.214515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:35.215299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:35.215736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:35.243954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b0f53f6-342c-4d84-83d5-3037d78c72f7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040928 Nov 24 18:29:35.244499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 750/1496] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:36.256090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:36.257020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:36.263419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:36.263870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:36.264673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:36.265109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:36.295134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ff7f4de2-a8d7-4168-a3b5-00de886c9fff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Nov 24 18:29:36.295693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 747/1497] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:37.309496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:37.309496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:37.315045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:37.315523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:37.316303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:37.316788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:37.347110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-11d7cd81-f424-4d4f-ac4f-cc0bd5c985b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Nov 24 18:29:37.349714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 751/1498] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:38.359353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:38.360284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:38.366230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:38.366682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:38.367466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:38.367906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:38.398670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-80f24746-53f2-413c-8ce8-17492b0eb48c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Nov 24 18:29:38.399147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 748/1499] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:39.410225 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:39.411146 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:39.417328 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:39.418910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:39.419686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:39.420125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:39.448860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6f8dd0de-4d97-4b74-a62f-96356fdb4c91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Nov 24 18:29:39.449405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 752/1500] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:40.460116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:40.461031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:40.466942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:40.467399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:40.468182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:40.468623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:40.498027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f32cee90-91df-4934-8e82-12d349d6b6be tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041742 Nov 24 18:29:40.498580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 749/1501] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:41.508371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:41.509395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:41.515993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:41.516437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:41.517211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:41.517800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:41.548191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9ba43b84-f445-426e-8fc4-1170e4bf21a5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Nov 24 18:29:41.548732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 753/1502] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:42.559528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:42.560446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:42.567320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:42.567780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:42.568640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:42.569084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:42.598163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4289c709-90cf-4ff8-9348-10d4566068ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Nov 24 18:29:42.598716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 750/1503] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:43.608825 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:43.609826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:43.616481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:43.616929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:43.617699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:43.618155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:43.647853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-489145ec-39d8-45f6-9292-1238b14f84d8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Nov 24 18:29:43.648394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 754/1504] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:44.659004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:44.659920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:44.666186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:44.666640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:44.667546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:44.668264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:44.697330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d299c7af-a6e7-43c4-8272-6e7693dacfcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041968 Nov 24 18:29:44.697913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 751/1505] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:45.709426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:45.710385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:45.718232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:45.718656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:45.719566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:45.720006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:45.750198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-953ab1aa-7f88-4df1-a0e4-748ca7647ad2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Nov 24 18:29:45.750752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 755/1506] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:46.761644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:46.762587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:46.769469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:46.769950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:46.770722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:46.771153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:46.800922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6eb5c001-f918-49cf-ba41-2a8a4454835b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Nov 24 18:29:46.801515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 752/1507] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:47.813147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:47.814090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:47.820401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:47.820856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:47.821636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:47.822110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:47.854037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c7cbe459-0485-46ba-88d6-6364ceef791c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Nov 24 18:29:47.854533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 756/1508] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:48.865736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:48.866669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:48.873159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:48.873600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:48.874404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:48.874832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:48.903961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9a2b770f-d52a-4835-b5ca-b8e0dd03ada0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 Nov 24 18:29:48.904507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 753/1509] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:49.914091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:49.915067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:49.921666 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:49.922135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:49.922903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:49.923328 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:49.952444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-350f8448-c3d2-413c-a6d5-3c91d72eed3d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041999 Nov 24 18:29:49.952978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 757/1510] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:50.963368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:50.964292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:50.974105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:50.974569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:50.975362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:50.975805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:51.006815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eecdb425-0406-4dd4-b124-f75bcf0e51de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Nov 24 18:29:51.007533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 754/1511] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:52.018488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:52.019952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:52.026278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:52.027239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:52.028027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:52.028466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:52.058689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0e4f6162-1ca0-4a7b-be4c-341e294036dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Nov 24 18:29:52.059239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 758/1512] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:53.069512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:53.070448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:53.076991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:53.077439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:53.078465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:53.078912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:53.108029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c38243d0-ed7c-416e-aafd-daeaa331f090 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Nov 24 18:29:53.108577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 755/1513] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:54.119250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:54.120157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:54.127633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:54.128076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:54.128844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:54.129270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:54.158349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-72ffaed4-6be4-4485-b331-1dbad57b1e8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Nov 24 18:29:54.159038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 759/1514] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:55.177129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:55.178116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:55.184622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:55.185095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:55.186075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:55.186535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:55.216150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c8cfa72f-9377-45f0-921a-acd992e02049 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050495 Nov 24 18:29:55.216705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 756/1515] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:56.227298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:56.228205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:56.234881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:56.235335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:56.236122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:56.236563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:56.267227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-51f900f0-7544-4e9b-a77d-6c130d29239f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Nov 24 18:29:56.268034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 760/1516] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:57.279323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:57.280246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:57.286357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:57.286800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:57.287568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:57.287999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:57.317691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02c66dfe-5499-466f-a784-45e3fe686b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Nov 24 18:29:57.318261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 757/1517] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:58.328977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:58.329934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:58.336106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.336559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.337340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.337792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.369690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-486518e5-6186-4efb-912a-0300523f2da9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Nov 24 18:29:58.370732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 761/1518] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:58.370851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:58.371429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:58.377628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.378113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.378897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.379521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.405077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:29:58.755230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bef4639f-3ff3-4136-bd94-0ea4759e6234 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 204 len: 0 microversion: 2.1 time: 0.387948 Nov 24 18:29:58.755837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 758/1519] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:29:58 2021] DELETE /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:29:58.764768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:58.766232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:58.771260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.771708 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.772472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:58.772902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:58.976364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:29:58.984440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-31d7f1c8-8c94-4416-969e-b921c2df18a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1513 microversion: 2.1 time: 0.224446 Nov 24 18:29:58.984999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 762/1520] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:29:58 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:29:59.380914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:29:59.382245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:29:59.389749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:59.390282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:59.391062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:59.391489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:59.421283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dbae5f71-74d4-4616-95fd-4786ba7cab09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Nov 24 18:29:59.422047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 759/1521] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:29:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:29:59.831046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-c7e74753-b131-4f2e-ae29-70adbb52a813 req-70a2366e-cbf3-4320-a5a7-46fd00d6c614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61485fb2-fb34-4a48-81e1-18bf5b54539c", "name": "network-vif-deleted", "tag": "b172d6a5-f94e-47a6-83d2-1659c569b824"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:29:59.832645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:29:59.832645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:29:59.839568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-c7e74753-b131-4f2e-ae29-70adbb52a813 req-70a2366e-cbf3-4320-a5a7-46fd00d6c614 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:29:59.845053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-c7e74753-b131-4f2e-ae29-70adbb52a813 req-70a2366e-cbf3-4320-a5a7-46fd00d6c614 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:29:59.851963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-c7e74753-b131-4f2e-ae29-70adbb52a813 req-70a2366e-cbf3-4320-a5a7-46fd00d6c614 service nova] Creating event network-vif-deleted:b172d6a5-f94e-47a6-83d2-1659c569b824 for instance 61485fb2-fb34-4a48-81e1-18bf5b54539c on hv-cinder-80403 Nov 24 18:29:59.859442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-c7e74753-b131-4f2e-ae29-70adbb52a813 req-70a2366e-cbf3-4320-a5a7-46fd00d6c614 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093084 Nov 24 18:29:59.860038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 763/1522] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:29:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:00.001571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:00.002204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:00.008024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:00.008468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:00.009228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:00.009659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:00.125025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:00.132349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1cefe54e-0146-4666-abd4-58a72acf09c2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 200 len: 1302 microversion: 2.1 time: 0.134474 Nov 24 18:30:00.137001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 760/1523] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:29:59 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:00.433644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:00.434928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:00.441024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:00.441475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:00.442284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:00.442738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:00.472101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e47d2fd4-64b6-4fed-98e7-57c39d9165f0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Nov 24 18:30:00.472759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 764/1524] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:01.148632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:01.149231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 61485fb2-fb34-4a48-81e1-18bf5b54539c] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:01.156044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:01.156491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:01.157256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:01.157689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:01.204875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Instance 61485fb2-fb34-4a48-81e1-18bf5b54539c could not be found. Nov 24 18:30:01.204875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 404 to user: Instance 61485fb2-fb34-4a48-81e1-18bf5b54539c could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:30:01.204875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-11b9e533-4400-4cdf-8b73-aacf337a9a47 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c" status: 404 len: 111 microversion: 2.1 time: 0.036519 Nov 24 18:30:01.204875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 761/1525] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:01 2021] GET /compute/v2.1/servers/61485fb2-fb34-4a48-81e1-18bf5b54539c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:30:01.484261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:01.485236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:01.495855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:01.495855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:01.495855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:01.495855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:01.529777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b8072164-1227-4cdd-8658-5d93de6d5f12 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Nov 24 18:30:01.533462 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 765/1526] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:02.540525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:02.541389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:02.548416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:02.548870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:02.549657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:02.550130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:02.582255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1d39fdbb-1159-41e7-adbd-fd184c8760e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Nov 24 18:30:02.582813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 762/1527] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:03.593874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:03.598133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:03.601254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:03.601802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:03.602684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:03.603189 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:03.638301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d64f4aa0-a7ba-4f01-b2ce-7ddf07a18efa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047557 Nov 24 18:30:03.638301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 766/1528] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:04.653867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:04.654783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:04.661001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:04.661453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:04.662271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:04.662714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:04.695830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7706733e-3f0e-4623-8e2e-eebb679cae0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Nov 24 18:30:04.696391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 763/1529] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:05.708414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:05.709384 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:05.716224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:05.716668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:05.717437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:05.717894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:05.747800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3be3f8eb-df7e-4495-b4d4-ebb854450f09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Nov 24 18:30:05.748594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 767/1530] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:06.759058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:06.760615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:06.767412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:06.767868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:06.768658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:06.769107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:06.804292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-590ae84c-ce6e-412d-beb3-ea125fc4fa8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Nov 24 18:30:06.804865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 764/1531] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:07.816010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:07.816922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:07.831369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:07.832172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:07.833480 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:07.834157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:07.873611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2e2d0111-9381-4abe-b7e8-e0f7dc2f4d81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061271 Nov 24 18:30:07.874240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 768/1532] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:08.825618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:08.826226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:08.832804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:08.833368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:08.834052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:08.834490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:08.859462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:30:08.884393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:08.885553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:08.892795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:08.893375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:08.894253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:08.894766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:08.925403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-eb29b488-ff7c-4b16-b879-da4a48642cef tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Nov 24 18:30:08.926173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 769/1533] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:09.152917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9472f73d-cb09-47eb-98ab-b3afbade7152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 204 len: 0 microversion: 2.1 time: 0.331561 Nov 24 18:30:09.153553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 765/1534] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:30:08 2021] DELETE /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:30:09.161591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:09.162243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:09.169295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:09.169745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:09.170552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:09.170989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:09.303411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:09.311809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a9274de9-c123-43b4-ab62-9765a3452476 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153865 Nov 24 18:30:09.312367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 770/1535] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:09.938113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:09.939114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:09.944943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:09.945414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:09.946225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:09.946659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:09.975796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9b8bcf0-3bf8-4c60-a266-0870c40cbeab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041950 Nov 24 18:30:09.976365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 766/1536] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:10.328872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:10.329488 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:10.335588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:10.336046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:10.336813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:10.337248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:10.465493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:10.473135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-901e814c-0b2e-4285-96d7-7de138e337a7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148069 Nov 24 18:30:10.473686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 771/1537] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:10.987596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:10.988507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:10.994642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:10.995617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:10.996378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:10.996803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:11.026691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e4908aaf-d1f9-45e7-b082-1a2aa79a7181 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Nov 24 18:30:11.027255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 767/1538] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:11.489380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:11.490049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:11.497266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:11.497718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:11.498523 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:11.498961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:11.631196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:11.638850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0f5d9d82-c943-4293-9285-7048d8df4860 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153282 Nov 24 18:30:11.639409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 772/1539] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:12.037742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:12.038681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:12.045718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:12.046380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:12.047155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:12.047587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:12.077420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-94678a7e-931c-4599-a8de-6a5443e4f956 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Nov 24 18:30:12.078009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 768/1540] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:12.656027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:12.656640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:12.662927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:12.663374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:12.664142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:12.664574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:12.795946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:12.803860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-578fd7e8-e35a-48af-8dc5-0b44ed665751 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151535 Nov 24 18:30:12.804418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 773/1541] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:12 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:13.088304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:13.089243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:13.095468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:13.096111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:13.096893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:13.097335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:13.129239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6ccdeb2-4a3e-4877-992d-64a1710ce2e5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Nov 24 18:30:13.129824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 769/1542] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:13.821918 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:13.822441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:13.829706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:13.830195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:13.830967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:13.831443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:13.961366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:13.969881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-48cafd97-0a3f-421b-9a3c-3568b5325071 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151756 Nov 24 18:30:13.973243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 774/1543] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:13 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:14.140862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:14.141830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:14.148168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:14.148616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:14.149393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:14.149882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:14.180801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-089ff914-8aaa-40c8-8923-90250917dfe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Nov 24 18:30:14.181361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 770/1544] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:14.986165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:14.986781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:14.993275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:14.993725 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:14.994571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:14.996082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:15.127096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:15.134731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f5dd79b7-312f-409a-9a7e-4e222fd26b69 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152234 Nov 24 18:30:15.142847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 775/1545] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:14 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:15.192044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:15.192966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:15.199485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:15.200242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:15.201038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:15.201477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:15.230885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-db854498-ccf0-4a93-bf2d-29ddbf3888c5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Nov 24 18:30:15.231447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 771/1546] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:16.153502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:16.154648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:16.161414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:16.161899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:16.165377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:16.165853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:16.242887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:16.243800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:16.250963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:16.251950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:16.252167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:16.252601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:16.288456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee2bb7ff-5d65-4523-b0ea-e97b6a25f402 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049678 Nov 24 18:30:16.289102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 772/1547] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:16.302278 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:16.312215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-079950d8-cae3-4c58-8e9e-fbeb3ceda9ac tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.163965 Nov 24 18:30:16.312882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 776/1548] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:17.299766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:17.300685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:17.306939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:17.308291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:17.309087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:17.309529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:17.329119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:17.329957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:17.336100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:17.336856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:17.337995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:17.338501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:17.342542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-483eab79-90d4-467e-9fb0-e94a68f8c94e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Nov 24 18:30:17.343324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 773/1549] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:17.471298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:17.479514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-17a2fc50-2ab2-4684-8bce-54e7001e0b88 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153590 Nov 24 18:30:17.480185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 777/1550] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:18.353842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:18.354755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:18.362256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:18.362712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:18.363509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:18.363969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:18.393844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-73b98600-9808-47ae-b63a-871678ad4700 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Nov 24 18:30:18.394409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 774/1551] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:18.496235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:18.496904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:18.503091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:18.503529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:18.504296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:18.504723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:18.632792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:18.641297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-99d7749c-7b72-4a07-a7c4-5716778c28b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148730 Nov 24 18:30:18.641819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 778/1552] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:19.404372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:19.405283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:19.411603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:19.412060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:19.412865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:19.413307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:19.443987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-464bfddd-9fa7-4d1a-b1b3-f743cc597b91 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043388 Nov 24 18:30:19.448577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 775/1553] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:19.658011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:19.658646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:19.664925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:19.665375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:19.666192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:19.666655 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:19.801256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:19.809736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4ebee3ce-f9d9-43fc-8ed7-0adb25254a45 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154493 Nov 24 18:30:19.810347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 779/1554] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:19 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:20.455703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:20.456608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:20.462820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:20.463262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:20.464374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:20.464803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:20.494126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08b8d32f-01a8-47a6-a297-31ece02cc507 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Nov 24 18:30:20.494696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 776/1555] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:20.826768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:20.827290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:20.833569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:20.834049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:20.834830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:20.835262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:20.962840 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:20.971658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e71e690a-363c-4bb0-8c43-5c16fab74804 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148593 Nov 24 18:30:20.972218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 780/1556] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:20 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:21.506070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:21.507122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:21.513500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:21.513987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:21.514747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:21.515177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:21.545295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-32ba7b0b-1fae-4035-8519-36efe9e15a78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Nov 24 18:30:21.546102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 777/1557] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:21.989596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:21.990245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:21.997223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:21.997673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:21.998474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:21.998909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:22.128820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:22.136456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a3c945d6-9728-46ac-91a6-52a235bb3c18 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150566 Nov 24 18:30:22.137613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 781/1558] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:21 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:22.556508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:22.557344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:22.564800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:22.565248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:22.566054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:22.566493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:22.598903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-da0dd24e-222c-4dee-9757-30799ff8af11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Nov 24 18:30:22.600551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 778/1559] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:23.153904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:23.154517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:23.160713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:23.161161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:23.161957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:23.162391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:23.294906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:23.302537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b9e51510-d1ec-42eb-8e77-b4562f78de29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152544 Nov 24 18:30:23.303090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 782/1560] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:23.612276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:23.613213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:23.619761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:23.620217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:23.621669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:23.622295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:23.651429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-af0e9b85-54aa-4874-ae4b-9cdb650b8278 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Nov 24 18:30:23.651989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 779/1561] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:24.320332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:24.320945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:24.327249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:24.327701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:24.328473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:24.328910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:24.455677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:24.463371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-56ff1b03-d59d-460a-b6ae-82d7dba7b4eb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146812 Nov 24 18:30:24.463938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 783/1562] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:24.662975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:24.663899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:24.671267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:24.671643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:24.672583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:24.672832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:24.702301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b671a047-829b-4574-88b0-d1e6d0fb9342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Nov 24 18:30:24.702864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 780/1563] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:25.480064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:25.480675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:25.486866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:25.487313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:25.488076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:25.488506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:25.622088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:25.630009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-038acca4-c48f-4b43-bdb5-54740741564b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153475 Nov 24 18:30:25.630569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 784/1564] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:25.713519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:25.714368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:25.721971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:25.722430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:25.723217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:25.723688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:25.754222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a40b933f-9caf-4659-957c-f13b2c595a09 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Nov 24 18:30:25.755072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 781/1565] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:26.647207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:26.647823 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:26.654963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:26.655414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:26.656194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:26.656631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:26.767216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:26.767947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:26.777546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:26.778033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:26.778830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:26.779258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:26.788096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:26.796346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fb372731-3ff8-4cb3-9631-2e8ffc0ebb11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152669 Nov 24 18:30:26.797015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 785/1566] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:26 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:26.814198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3a8b42e5-1717-4745-ab5c-3430f8e3a55a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051049 Nov 24 18:30:26.814862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 782/1567] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:27.813765 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:27.814405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:27.820811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:27.821257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:27.822058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:27.822524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:27.825955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:27.826875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:27.833543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:27.834057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:27.834830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:27.835243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:27.867070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48344821-ade6-4522-a30d-15b561e6af1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Nov 24 18:30:27.867907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 783/1568] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:27.973683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:27.982292 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-db939ddd-eab1-4264-b234-55ec5470837d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.172078 Nov 24 18:30:27.982868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 786/1569] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:28.878615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:28.879530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:28.886991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:28.887716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:28.888814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:28.889254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:28.924029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42315315-3257-4e08-883b-8374e9834216 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048879 Nov 24 18:30:28.927627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 784/1570] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:28.999774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:29.000504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:29.007040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:29.007565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:29.008348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:29.008830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:29.147521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:29.156429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c3e3bf24-2dbe-4dd4-9fe3-b59ad4c5c7f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.160864 Nov 24 18:30:29.157094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 787/1571] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:28 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:29.542911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:30:29.543490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:30:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:30:29.935905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:29.936849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:29.943545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:29.944197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:29.945147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:29.945739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:29.979574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-610fa028-70e0-41bc-9ff3-0354e683b49a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 Nov 24 18:30:29.984111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 785/1572] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:30.173934 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:30.174538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:30.181339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:30.182057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:30.183005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:30.183425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:30.193362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe76ff21-f786-40c4-911c-9376870dad7e tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] Calling method '.version_select at 0x7f8ba86b6a60>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:30.284863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe76ff21-f786-40c4-911c-9376870dad7e tempest-TestShelveInstance-183597206 tempest-TestShelveInstance-183597206-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2118389392" status: 202 len: 0 microversion: 2.1 time: 0.095490 Nov 24 18:30:30.285451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 786/1573] 10.222.0.53 () {58 vars in 1253 bytes} [Wed Nov 24 18:30:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2118389392 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:30:30.336561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:30.347138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b25db67d-8037-4bd6-888d-b5e03f5882ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.176776 Nov 24 18:30:30.347969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 788/1574] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:30.387884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:30:30.388088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:30:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:30:30.992391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:30.994076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:31.002212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:31.002666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:31.004884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:31.004884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:31.037090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0912fbdb-ca31-4aa7-aa05-ef48b253ed46 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049082 Nov 24 18:30:31.038597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 787/1575] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:31.366650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:31.367430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:31.377210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:31.377654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:31.378501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:31.378935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:31.535335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:31.544862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-655301a5-5a03-4e1a-8698-ae0012f60bc4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.181949 Nov 24 18:30:31.545443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 789/1576] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:32.049529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:32.050733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:32.057734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:32.058216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:32.059863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:32.060298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:32.095620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1d96c765-7c48-4937-9e34-6ac8b63e7b0f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049898 Nov 24 18:30:32.098287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 788/1577] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:32.563584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:32.564772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:32.572836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:32.573524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:32.575100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:32.575901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:32.731305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:32.740352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f623f9c7-7fa0-491a-bc98-7cba6b441319 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.181718 Nov 24 18:30:32.741517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 790/1578] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:33.108738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:33.111281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:33.119842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:33.120523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:33.121585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:33.122125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:33.161108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a8070dfe-2bb9-45b7-bd83-05105714e621 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057736 Nov 24 18:30:33.161969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 789/1579] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:33.758425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:33.759803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:33.769165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:33.769610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:33.775027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:33.775027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:34.186854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:34.187794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:34.212170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:34.214084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:34.218918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:34.221057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:34.295456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cfcec510-e272-4b21-a1c4-4d5a9ac34107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125878 Nov 24 18:30:34.297222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 790/1580] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:34.382314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:34.392207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3ac33830-0021-4976-8c1e-7e52fb7a67c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.637460 Nov 24 18:30:34.393656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 791/1581] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:33 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:35.307519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:35.308664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:35.316093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:35.316785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:35.317577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:35.318113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:35.361699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95413332-3732-43e6-81f0-b0e2dcfd0da8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057865 Nov 24 18:30:35.362792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 791/1582] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:35.410175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:35.410814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:35.418428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:35.419053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:35.420016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:35.420604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:35.561788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:35.572789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e9e81ab7-56f5-43fc-bb5c-11f067466fa5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.166413 Nov 24 18:30:35.573369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 792/1583] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:36.374193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:36.375709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:36.381993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:36.382434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:36.383222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:36.383655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:36.417698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-41500b02-8415-4084-a79b-ca107d2d17d6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Nov 24 18:30:36.418436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 792/1584] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:36.593500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:36.594599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:36.603766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:36.604458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:36.605949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:36.606669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:36.865089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:36.876187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-394a220b-c693-4e33-997f-247220da3dfc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.289486 Nov 24 18:30:36.877397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 793/1585] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:36 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:37.429045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:37.430062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:37.437593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:37.438101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:37.438891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:37.439329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:37.470888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d21b79b1-60a5-46ad-8d25-ba623bb01308 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045531 Nov 24 18:30:37.474823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 793/1586] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:37.893352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:37.894728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:37.900826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:37.901271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:37.902898 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:37.903286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:38.044414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:38.052165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-95071f79-98b0-4cbd-99e5-6a580a9a87a9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.162596 Nov 24 18:30:38.053102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 794/1587] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:38.483837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:38.484699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:38.497644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:38.498411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:38.500082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:38.500730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:38.549285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-390795d2-4caf-4ae2-817c-830b70620819 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070720 Nov 24 18:30:38.549933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 794/1588] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:39.069394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:39.069950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:39.076598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:39.077057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:39.077870 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:39.078314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:39.209888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:39.218569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2cd27c04-492c-4a3d-8f69-71627ffa8bca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152836 Nov 24 18:30:39.219140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 795/1589] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:39.560944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:39.561895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:39.568240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:39.568693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:39.569476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:39.569960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:39.599989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ca140b2-d97f-4ed5-b132-b454c4b61821 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Nov 24 18:30:39.600560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 795/1590] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:40.235409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:40.236550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:40.242656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:40.243299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:40.246581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:40.246581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:40.379459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:40.388135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ecf6860b-84ee-4dc0-ac64-7ab636d437dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156494 Nov 24 18:30:40.388697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 796/1591] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:40 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:40.612823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:40.613745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:40.620039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:40.620485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:40.622530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:40.623404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:40.657249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6a69fa48-bc1c-4389-9ce9-78ba9be81f80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048106 Nov 24 18:30:40.658147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 796/1592] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:41.405428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:41.406158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:41.412485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:41.412942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:41.413782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:41.420788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:41.544610 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:41.552633 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6f91562c-d8c3-4b44-bfb6-f573919a8394 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151226 Nov 24 18:30:41.563027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 797/1593] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:41.669574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:41.670496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:41.676658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:41.677102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:41.677896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:41.678331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:41.706845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b998420b-d1e2-4a77-ae99-a86f421a31cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Nov 24 18:30:41.707386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 797/1594] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:42.570184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:42.570818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:42.578305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:42.578753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:42.579534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:42.579968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:42.706011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:42.713705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d7e74b92-c1fc-49be-bef9-548fbf4ab9b6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147090 Nov 24 18:30:42.714316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 798/1595] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:42.717594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:42.718530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:42.724689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:42.725137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:42.725949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:42.726387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:42.754847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5df19807-ea43-4fe2-9f30-1c2ed7719e5f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Nov 24 18:30:42.755391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 798/1596] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:43.731242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:43.731858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:43.738111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:43.738562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:43.739336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:43.739771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:43.766269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:43.767180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:43.774073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:43.774573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:43.775354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:43.775790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:43.806573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-05e7cb2c-d73f-480c-8611-5c37d6a8d156 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Nov 24 18:30:43.807141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 799/1597] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:43.872306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:43.879920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-440706d7-3c65-44c1-a029-2d18f442dd91 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152945 Nov 24 18:30:43.880480 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 799/1598] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:43 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:44.818665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:44.819506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:44.826358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:44.826816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:44.827603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:44.828039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:44.856354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eeded01c-df2a-48b0-9638-694d3de57f83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Nov 24 18:30:44.856908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 800/1599] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:44.896070 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:44.896887 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:44.903641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:44.904092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:44.904877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:44.905318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:45.034754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:45.041672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7cd891ed-1f06-40ad-96a4-d4751a3e9c65 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149266 Nov 24 18:30:45.042591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 800/1600] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:45.867323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:45.868164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:45.874864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:45.875308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:45.876078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:45.876509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:45.906572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23969c8f-2095-477c-a39b-0b833330bec0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Nov 24 18:30:45.907127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 801/1601] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:46.059188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:46.059799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:46.066129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:46.066578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:46.067397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:46.067835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:46.201845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:46.209598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-baae7d8b-a5a8-4240-b682-27ab313a299e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154250 Nov 24 18:30:46.210177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 801/1602] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:46.918068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:46.918982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:46.925175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:46.925629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:46.926448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:46.926886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:46.955314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bd785405-5142-478f-89f4-ce2b83c57c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 Nov 24 18:30:46.955868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 802/1603] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:47.226176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:47.226791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:47.233335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:47.233798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:47.234579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:47.235015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:47.364624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:47.372709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f4ee3bb6-17c4-48a7-a615-d61591ab641e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150177 Nov 24 18:30:47.373272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 802/1604] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:47 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:47.967006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:47.967920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:47.974136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:47.974587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:47.975357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:47.975794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:48.004971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a2fa836e-1e72-4797-b272-6151c01c3830 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Nov 24 18:30:48.005522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 803/1605] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:30:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:48.389693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:48.390349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:48.396625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:48.397074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:48.397875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:48.398315 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:48.527531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:48.535369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-589f265f-0f4f-4c35-94aa-4f66b1726909 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149426 Nov 24 18:30:48.535935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 803/1606] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:49.200948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:49.201890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:49.207640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:49.208080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:49.208843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:49.209271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:49.289655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-94053178-83cd-4caf-bc19-85642fdea282 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action" status: 200 len: 76413 microversion: 2.1 time: 0.276637 Nov 24 18:30:49.290360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 804/1607] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:30:49 2021] POST /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0/action => generated 76413 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:30:49.552758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:49.553376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:49.560560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:49.561015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:49.561935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:49.562381 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:49.695942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:49.704506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-518a0c87-40cf-479e-95f1-fce1a78cddc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155464 Nov 24 18:30:49.705067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 804/1608] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:50.730026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:50.730764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:50.737719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:50.738195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:50.738996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:50.739454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:50.869351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:50.878253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e0b7a84c-8f1b-4bd9-bfad-13351280efc6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152288 Nov 24 18:30:50.878831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 805/1609] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:50 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:51.896004 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:51.896657 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:51.904423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:51.904920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:51.905741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:51.906212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:52.041093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:52.049085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-15a19afd-f6f3-4689-a905-804ecad59e2a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156809 Nov 24 18:30:52.049669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 805/1610] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:53.065469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:53.066105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:53.072386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:53.072831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:53.073665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:53.074290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:53.202811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:53.210379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3631bb18-4b22-4580-a477-dbb68bdb36b1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148500 Nov 24 18:30:53.210941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 806/1611] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:54.227592 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:54.228208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:54.234564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:54.235021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:54.235797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:54.236234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:54.366820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:54.374500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-39ea503b-1146-4933-beaa-a5c13012361b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150545 Nov 24 18:30:54.375049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 806/1612] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:54 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:55.391291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:55.391851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:55.398080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:55.398529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:55.399298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:55.399731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:55.529015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:55.536623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-81b7774b-5333-40c0-8259-ab1d58f2b6e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149141 Nov 24 18:30:55.537194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 807/1613] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:55 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:56.554412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:56.554952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:56.562088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:56.562546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:56.563317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:56.563743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:56.695068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:56.703232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5aa7a650-1f0a-4f7f-b55a-383708d5c974 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152494 Nov 24 18:30:56.703806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 807/1614] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:57.719720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:57.720422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:57.727113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:57.727570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:57.728384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:57.728823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:57.859915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:57.867641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9d25048-e051-42f6-b52a-8a2b63a2b01f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151526 Nov 24 18:30:57.868197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 808/1615] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:57 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:58.885285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:58.886624 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:30:58.893057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:58.893777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:58.894565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:30:58.895003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:30:59.026360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:59.034076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0fe13ea3-fe7f-4731-a1ea-b1e244b0cff8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152380 Nov 24 18:30:59.034637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 808/1616] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:00.051199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:00.051714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:00.058593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:00.059039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:00.059801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:00.060234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:00.197407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:00.205856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-94be3baa-0ea8-4ab7-9555-abbb1c8eba57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.158444 Nov 24 18:31:00.206420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 809/1617] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:01.222382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:01.223034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:01.229308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:01.229997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:01.230912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:01.231351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:01.360248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:01.367903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e8e98df3-39d5-4a22-aae4-c2dd7fdf1759 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149168 Nov 24 18:31:01.368460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 809/1618] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:01 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:02.384416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:02.385037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:02.391939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:02.392387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:02.393161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:02.393595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:02.520586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:02.528827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77b2fad4-0aed-4c20-9dfd-acc35946613c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148096 Nov 24 18:31:02.529388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 810/1619] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:03.545627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:03.546268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:03.552465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:03.552916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:03.553691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:03.554155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:03.682033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:03.690366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-92c8aa55-e19d-41af-8ece-703e3e4e9636 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148893 Nov 24 18:31:03.690932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 810/1620] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:31:04.707811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:04.708449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:04.714858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:04.715305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:04.716086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:04.716526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:04.846698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:04.854530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83e9c103-9cbe-4030-aad2-0889af369414 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150369 Nov 24 18:31:04.855107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 811/1621] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:04 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:05.871830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:05.872475 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:05.878804 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:05.879269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:05.880049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:05.880481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:06.015033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:06.022796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-11eee810-ebc2-4314-b5bf-78393d756b54 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155061 Nov 24 18:31:06.023549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 811/1622] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:07.040101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:07.040724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:07.048098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:07.048549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:07.049327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:07.049779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:07.186567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:07.194273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ddea2364-c0f1-47c9-b2b5-a5e50ca9a8d8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.157827 Nov 24 18:31:07.194831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 812/1623] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:07 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:08.211413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:08.212027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:08.218777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:08.219226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:08.220005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:08.220435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:08.349852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:08.358327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0e5078a4-fc8b-4bd1-b5ef-07d1af552ea1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150527 Nov 24 18:31:08.358892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 812/1624] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:08 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:09.375480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:09.376094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:09.382306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:09.382756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:09.383531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:09.383965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:09.510859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:09.518537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96358b9b-c37a-4afa-8902-a7e46ec0bcf6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146658 Nov 24 18:31:09.519108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 813/1625] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:10.536257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:10.536774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:10.542941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:10.543385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:10.544142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:10.544570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:10.681230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:10.689107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3b922d49-7637-4ddb-800a-e2a098bbe569 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156654 Nov 24 18:31:10.689662 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 813/1626] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:11.706317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:11.706961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:11.713194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:11.714466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:11.715006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:11.715443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:11.844819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:11.852641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e8a8593a-afa2-4228-9981-55669757b74e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149967 Nov 24 18:31:11.853200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 814/1627] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:12.870711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:12.871411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:12.877511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:12.878001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:12.878788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:12.879213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:13.006168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:13.014372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-74f24662-7197-4b92-a422-54acf15fd310 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147974 Nov 24 18:31:13.014931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 814/1628] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:12 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:14.030852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:14.031467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:14.037675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:14.038163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:14.038936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:14.039373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:14.172975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:14.180755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4ef9ead3-49f0-4628-b25b-060fb15a7d1c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153527 Nov 24 18:31:14.181321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 815/1629] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:14 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:15.198544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:15.199139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:15.205358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:15.205845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:15.206621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:15.207061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:15.334128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:15.342787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-194167a3-60ba-4bcd-ae87-e13e0a67ff77 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148400 Nov 24 18:31:15.343358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 815/1630] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:15 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:16.360289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:16.360845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:16.367215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:16.367665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:16.368437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:16.368869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:16.500114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:16.507765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6a0afcd5-a222-4066-8256-d8458b6e7eee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151196 Nov 24 18:31:16.508325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 816/1631] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:17.524581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:17.525187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:17.531492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:17.531932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:17.532691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:17.533125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:17.669298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:17.677583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-aaa7deb2-6f13-4388-9e3c-4137fa9dce6f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156662 Nov 24 18:31:17.678178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 816/1632] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:17.725680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:17.726225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:17.733451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:17.733921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:17.734688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:17.735116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:17.758843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:31:17.990777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1198072-c55a-457a-8beb-b38ea05fbefb tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 204 len: 0 microversion: 2.20 time: 0.268397 Nov 24 18:31:17.991374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 817/1633] 10.222.0.53 () {60 vars in 1279 bytes} [Wed Nov 24 18:31:17 2021] DELETE /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:31:17.999814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:18.000451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:18.006288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:18.006736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:18.007502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:18.007937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:18.142286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:18.149919 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:18.152184 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:18.153339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-15105f37-8c78-4cef-bd40-65f6aa408ed0 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1723 microversion: 2.20 time: 0.157301 Nov 24 18:31:18.153931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 817/1634] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:31:17 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:31:18.694829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:18.699886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:18.702094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:18.702546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:18.703338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:18.703782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:18.967610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:18.975615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83700223-447b-4031-8075-d1d7bdcdf3fe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.284743 Nov 24 18:31:18.976274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 818/1635] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:19.172676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:19.173289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:19.179704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:19.180156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:19.180939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:19.181377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:19.255503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:19.264129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:19.265612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:19.266828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-682ca2ea-ae14-4c2a-b819-e715656c3c55 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1656 microversion: 2.20 time: 0.097978 Nov 24 18:31:19.269803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 818/1636] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:31:19 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:31:19.471161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-e98d122d-052e-40bc-84c0-15b7af5dbef9 req-ec83a309-2de3-4004-9bd4-925beba636cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f647ca-2f72-4260-93ad-0b9e49ec7d16", "name": "network-vif-deleted", "tag": "906d31e1-a29f-435d-ab11-d57c4a281fa9"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:31:19.473054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:31:19.473054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:31:19.481117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e98d122d-052e-40bc-84c0-15b7af5dbef9 req-ec83a309-2de3-4004-9bd4-925beba636cb service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:19.481852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e98d122d-052e-40bc-84c0-15b7af5dbef9 req-ec83a309-2de3-4004-9bd4-925beba636cb service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:19.493033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-e98d122d-052e-40bc-84c0-15b7af5dbef9 req-ec83a309-2de3-4004-9bd4-925beba636cb service nova] Creating event network-vif-deleted:906d31e1-a29f-435d-ab11-d57c4a281fa9 for instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 on hv-cinder-80403 Nov 24 18:31:19.498989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-e98d122d-052e-40bc-84c0-15b7af5dbef9 req-ec83a309-2de3-4004-9bd4-925beba636cb service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031314 Nov 24 18:31:19.499514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 819/1637] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:31:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:31:19.992293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:19.992899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:19.999686 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:20.000126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:20.000900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:20.001345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:20.144045 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.154012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e76ae59a-db2d-4576-9385-08c509472217 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.165304 Nov 24 18:31:20.157843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 819/1638] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:19 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:20.287445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:20.288786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:20.301957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:20.302630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:20.303472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:20.304040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:20.343173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:20.343631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:20.344089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lazy-loading 'fault' on Instance uuid 73f647ca-2f72-4260-93ad-0b9e49ec7d16 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:31:20.395563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.405408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.407172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08081398b694e24b07c10987ceefaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f199730bd61b4b36b03f26cd2239415a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.408439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96d2cce0-800c-4f98-84dc-cd94634caf8d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 200 len: 1372 microversion: 2.20 time: 0.126320 Nov 24 18:31:20.420404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 820/1639] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:31:20 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:31:21.172224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:21.172832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:21.179096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:21.179540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:21.180306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:21.180739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:21.311145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:21.318980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-12c461e5-a40e-4282-9442-c288dfe1a09d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150376 Nov 24 18:31:21.319541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 820/1640] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:21 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:21.427536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:21.428177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:21.435619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:21.436098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:21.436891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:21.437333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:21.452040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. Nov 24 18:31:21.459267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:31:21.459267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6efd6a85-92ba-4851-a4c2-f32a0b10473d tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 404 len: 111 microversion: 2.20 time: 0.029778 Nov 24 18:31:21.459267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 821/1641] 10.222.0.53 () {60 vars in 1276 bytes} [Wed Nov 24 18:31:21 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 18:31:21.462248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0732e731-9313-4100-bb59-d20580d628c2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '.version_select at 0x7f8ba85e15e0>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:21.594800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0732e731-9313-4100-bb59-d20580d628c2 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105410190" status: 204 len: 0 microversion: 2.20 time: 0.136086 Nov 24 18:31:21.595393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 821/1642] 10.222.0.53 () {60 vars in 1261 bytes} [Wed Nov 24 18:31:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105410190 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:31:22.336062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:22.336773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:22.343884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:22.344925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:22.345302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:22.345730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:22.492413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:22.500735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-72cf439b-2d10-4804-908a-73848402a944 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.168360 Nov 24 18:31:22.501317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 822/1643] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:22 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:23.518032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:23.518635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:23.525162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:23.525609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:23.526526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:23.526952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:23.658227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:23.665926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-95caa8ab-35a3-4b8b-b782-67d6629b4f71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152086 Nov 24 18:31:23.667374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 822/1644] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:24.684199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:24.684806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:24.691084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:24.691545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:24.692326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:24.692766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:24.827214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:24.835208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-61d99c9c-00bd-4814-aa77-676fe663735c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155281 Nov 24 18:31:24.835778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 823/1645] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:25.852181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:25.852799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:25.859534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:25.864945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:25.864945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:25.864945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:25.993160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:26.001400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-344961eb-4a87-4e77-b8f2-e6deec4de2ce tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152925 Nov 24 18:31:26.001997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 823/1646] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:27.019478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:27.020091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:27.026787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:27.027235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:27.027999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:27.028435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:27.161428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:27.170544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1e175892-3aae-49ef-9681-fe95697c5778 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154717 Nov 24 18:31:27.171114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 824/1647] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:28.186454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:28.187005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:28.193242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:28.193687 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:28.194485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:28.194935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:28.322242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:28.330850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6c8b4e0-9df4-4c83-8225-d7823260cb3a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148188 Nov 24 18:31:28.331422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 824/1648] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:28 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:29.347512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:29.348133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:29.354453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:29.354894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:29.355663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:29.356100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:29.485488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:29.493264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-73827652-8b6d-407f-bcc9-5c38908844b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149437 Nov 24 18:31:29.493856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 825/1649] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:29 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:30.510638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:30.511249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:30.517482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:30.517967 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:30.518746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:30.519195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:30.647594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:30.656222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-04cdbf75-fe3c-4bfe-9939-bdd1445dc3e9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149229 Nov 24 18:31:30.656796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 825/1650] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:31.672920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:31.673512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:31.679685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:31.680130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:31.680891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:31.681320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:31.813269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:31.821032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-30baa723-4116-4edd-a817-4a8e36d370b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151844 Nov 24 18:31:31.821593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 826/1651] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:32.948641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:32.949249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:32.955064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:32.955504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:32.956264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:32.956691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:33.084677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:33.092439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-55ec959d-42f5-4401-a4d8-54543ae31ab5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.257713 Nov 24 18:31:33.093010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 826/1652] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:34.108719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:34.109282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:34.115511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:34.115959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:34.116725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:34.117155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:34.250533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:34.258186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9af0ec9-5529-417c-af7e-0fb8230569d1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153181 Nov 24 18:31:34.258748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 827/1653] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:34 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:35.274675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:35.275288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:35.282151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:35.282640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:35.283390 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:35.283828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:35.414572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:35.423231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-87608324-42ac-4aec-a060-8c1fb0efcaeb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152122 Nov 24 18:31:35.423802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 827/1654] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:36.440825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:36.446545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:36.447748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:36.448805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:36.449607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:36.450072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:36.580189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:36.588398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7288b02-51c1-4a4b-9f90-06506e04b051 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151464 Nov 24 18:31:36.589668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 828/1655] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:36 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:37.605003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:37.605534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:37.611941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:37.612392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:37.613169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:37.613608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:37.747957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:37.755636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a88f82e3-6105-4274-98cb-6f826c43a711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154416 Nov 24 18:31:37.756197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 828/1656] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:38.773131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:38.773746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:38.780242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:38.780690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:38.781474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:38.781945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:38.913673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:38.922153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-33d59703-4a72-4509-a04d-bc93c49dd88c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152603 Nov 24 18:31:38.922732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 829/1657] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:39.939737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:39.940426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:39.946713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:39.947152 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:39.947924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:39.949613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:40.079257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:40.086997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1cb2d836-a351-4964-9d19-5ffa6e094874 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151080 Nov 24 18:31:40.087565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 829/1658] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:41.104490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:41.105108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:41.110957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:41.111404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:41.112177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:41.112613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:41.246581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:41.254657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2f3326b7-3952-43c4-8a1f-e06ab6136bbf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154093 Nov 24 18:31:41.255236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 830/1659] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:42.272101 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:42.272712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:42.279824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:42.280268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:42.281035 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:42.281466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:42.408529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:42.416351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-34f8e4c6-b4e5-4cdd-a3aa-90abfa091de8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147728 Nov 24 18:31:42.417418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 830/1660] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:43.434199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:43.434813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:43.441007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:43.441456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:43.442256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:43.442690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:43.571522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:43.579460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-043e893b-4974-4b95-82e9-f4e1e1f548a5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149404 Nov 24 18:31:43.580029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 831/1661] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:43 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:44.596139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:44.596744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:44.603308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:44.603704 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:44.604656 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:44.605207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:44.739492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:44.748034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5b5afc34-d586-4d35-b74e-c4e50a66acc8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155566 Nov 24 18:31:44.748621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 831/1662] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:45.765930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:45.766549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:45.772732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:45.773182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:45.774000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:45.774436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:45.911373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:45.920398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9c59372f-bf62-4e1b-9c0e-39fdd91b4e29 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.158075 Nov 24 18:31:45.920985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 832/1663] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:46.936650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:46.937267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:46.943569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:46.944016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:46.944787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:46.945224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:47.071944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:47.080933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-34a8f94e-5c63-407f-bcb5-cf23386957f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147902 Nov 24 18:31:47.081506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 832/1664] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:48.097735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:48.098309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:48.105096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:48.105543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:48.106351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:48.106796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:48.237948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:48.246250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-44db61a5-6df9-4667-9c8a-bbd972a3b0d4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152234 Nov 24 18:31:48.246811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 833/1665] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:49.263169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:49.263785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:49.270132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:49.270587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:49.271359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:49.271792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:49.405393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:49.413317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8e32cc06-64ed-49a5-994c-08540e500f5a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153949 Nov 24 18:31:49.413907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 833/1666] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:50.431274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:50.431878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:50.438792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:50.439239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:50.440018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:50.440447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:50.573661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:50.581453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c28150b-4aea-4283-b7e5-d2c07955a104 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153878 Nov 24 18:31:50.582062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 834/1667] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:50 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:51.598434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:51.599052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:51.606027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:51.606482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:51.607257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:51.607694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:51.735284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:51.742836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fc1785a1-a5c1-466f-8300-f3bac703c2b9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148083 Nov 24 18:31:51.743391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 834/1668] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:52.761000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:52.761699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:52.767871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:52.768321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:52.769095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:52.769530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:52.896462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:52.904732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-06a6280f-6eba-4483-a8db-8d3fc419aa8f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148045 Nov 24 18:31:52.905304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 835/1669] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:53.922372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:53.922976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:53.929174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:53.929612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:53.930405 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:53.930836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:54.062222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:54.070067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8ae2d689-578c-47dc-9aff-1ca24f2b8349 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151325 Nov 24 18:31:54.070640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 835/1670] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:55.086937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:55.087482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:55.094070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:55.094522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:55.095296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:55.095729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:55.223926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:55.232319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7fab9bf3-d15e-4e99-b6cd-de20980dbd4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149174 Nov 24 18:31:55.232890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 836/1671] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:55 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:56.249888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:56.250503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:56.257329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:56.257798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:56.258574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:56.259010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:56.390063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:56.398195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-57ad281d-3972-4d51-96c5-424978f3e276 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152003 Nov 24 18:31:56.398778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 836/1672] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:57.415223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:57.416110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:57.423263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:57.423767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:57.424543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:57.424978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:57.558296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:57.566183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a3c97bf5-f324-4952-9c64-1e05ed5d7711 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154768 Nov 24 18:31:57.566787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 837/1673] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:57 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:58.583065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:58.583674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:58.590664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:58.591103 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:58.591862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:58.592291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:58.722290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:58.730502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-680f9f8d-a765-4e9b-8a18-902e53090857 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150595 Nov 24 18:31:58.731066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 837/1674] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:31:59.746853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:59.747489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:31:59.753727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:59.754211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:59.754988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:31:59.755425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:31:59.885149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:59.893304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9b8b0b4-5dac-428d-a4c8-cd8ca64b0d23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150228 Nov 24 18:31:59.893967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 838/1675] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:59 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:00.910463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:00.911107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:00.917570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:00.918056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:00.918869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:00.919308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:01.050275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:01.058409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-94c41d45-2969-4b70-a75b-567e3d27f544 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151273 Nov 24 18:32:01.058672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 838/1676] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:02.075558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:02.076062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:02.081991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:02.082435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:02.083215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:02.083647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:02.219814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:02.227641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7181a37e-5664-495a-b72c-2fecc01cd73e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156186 Nov 24 18:32:02.228136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 839/1677] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:03.244429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:03.244969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:03.251250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:03.251701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:03.252481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:03.252920 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:03.380108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:03.388387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3cd9c5b3-4ddd-4883-855f-0c1ff46464c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147567 Nov 24 18:32:03.388941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 839/1678] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:04.405624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:04.406259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:04.412631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:04.413080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:04.413895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:04.414336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:04.542468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:04.550234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bf75e438-f83e-4943-9778-8c708c2cb647 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148416 Nov 24 18:32:04.550810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 840/1679] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:04 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:05.567613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:05.568226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:05.574995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:05.575437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:05.576195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:05.576625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:05.708724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:05.717275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1338b6ed-502f-415c-b5f9-e43ed0e67f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153334 Nov 24 18:32:05.717858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 840/1680] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:06.734089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:06.734725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:06.741097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:06.741553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:06.742368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:06.742807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:06.877138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:06.884992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ec764d2b-49ce-40b5-a70d-495681c62388 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155280 Nov 24 18:32:06.886276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 841/1681] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:06 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:07.903024 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:07.903594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:07.909783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:07.910246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:07.911022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:07.911457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:08.039306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:08.047766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2fdaa2ae-7c9b-4252-b4d0-a1ff99c0f219 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148958 Nov 24 18:32:08.048325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 841/1682] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:07 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:09.064648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:09.065297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:09.071932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:09.072380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:09.074318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:09.074767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:09.200197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:09.207907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-20cd0c3c-63d3-4baa-a573-679a524248e1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147150 Nov 24 18:32:09.208487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 842/1683] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:10.224322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:10.224943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:10.230948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:10.231400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:10.232173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:10.232608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:10.359313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:10.376068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bc8d973c-6bf2-4846-8bd9-1d10ba30e95f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155180 Nov 24 18:32:10.376660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 842/1684] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:11.392664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:11.393363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:11.399043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:11.399489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:11.400252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:11.400677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:11.534517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:11.543323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-11abdfe1-5d4a-4cf8-80c3-ced294c08ca4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154462 Nov 24 18:32:11.543886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 843/1685] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:12.561886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:12.562534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:12.568892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:12.569341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:12.570164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:12.570595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:12.702258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:12.709993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d7fd4c0b-c4e6-4bbd-b02a-0b9a46afaf5d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153881 Nov 24 18:32:12.710562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 843/1686] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:12 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:13.726814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:13.727415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:13.734440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:13.734818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:13.735581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:13.736010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:13.867573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:13.875498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1e3d9be8-801e-4aaa-8912-6021713c43fc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152312 Nov 24 18:32:13.876059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 844/1687] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:13 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:14.892501 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:14.893055 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:14.899332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:14.899778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:14.900546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:14.901014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:15.029570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:15.037970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b2ff4d60-594b-4e9f-abfd-f9fd1dc610be tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149143 Nov 24 18:32:15.038530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 844/1688] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:14 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:16.054196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:16.054799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:16.062067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:16.062510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:16.063287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:16.063872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:16.196563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:16.204892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fbd2e3e2-ded0-4b18-8de2-d876cdac8d4e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154284 Nov 24 18:32:16.205465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 845/1689] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:17.222448 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:17.223053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:17.229823 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:17.230303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:17.231062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:17.231489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:17.363409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:17.371114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-19a4c92a-ce7e-4d87-8683-fa56568b63a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152267 Nov 24 18:32:17.371670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 845/1690] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:18.388329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:18.388843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:18.395116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:18.395568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:18.396337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:18.396772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:18.528151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:18.535794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2c928a11-dc61-416c-af5b-fcfc27e74f9e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151694 Nov 24 18:32:18.536361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 846/1691] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:19.553733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:19.554305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:19.561051 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:19.561499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:19.562342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:19.562783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:19.690596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:19.699239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2f84fb86-1454-4312-8e28-3a1ea4f532de tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149257 Nov 24 18:32:19.699813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 846/1692] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:19 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:20.715590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:20.716193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:20.722385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:20.722824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:20.723582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:20.724009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:20.852011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:20.860797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-04d8e6d8-9c52-4514-824a-0e15647e2815 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149212 Nov 24 18:32:20.861242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 847/1693] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:20 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:21.878190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:21.878190 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:21.884285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:21.884735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:21.886053 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:21.886490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:22.017954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:22.025674 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b0c15a24-ab70-4c01-a8d1-346cf0530bd3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151943 Nov 24 18:32:22.027063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 847/1694] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:21 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:23.044597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:23.045217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:23.051397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:23.051850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:23.052627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:23.053065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:23.180076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:23.188224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-81c4dc01-9e8f-4fce-b8cb-21c8e8f21ddd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148209 Nov 24 18:32:23.188794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 848/1695] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:24.204875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:24.205481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:24.211942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:24.212397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:24.213175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:24.214346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:24.343194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:24.350868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f93bff6a-0b8f-466a-b9fa-49d69fc5a28a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149579 Nov 24 18:32:24.351466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 848/1696] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:25.368469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:25.369026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:25.375275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:25.375726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:25.376510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:25.376947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:25.509903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:25.517525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9838bb2f-294e-47a5-b058-2c98fc1193ff tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152963 Nov 24 18:32:25.518122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 849/1697] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:26.534363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:26.534979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:26.541714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:26.542767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:26.543584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:26.544022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:26.672196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:26.679899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8d1789ab-9ce5-4b94-8814-5b81211355b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149166 Nov 24 18:32:26.680472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 849/1698] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:26 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:27.697755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:27.699001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:27.705205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:27.705652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:27.706458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:27.706894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:27.837264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:27.845255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4bd09e01-ad42-4cf6-9305-44cddfa2cf4f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151264 Nov 24 18:32:27.845838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 850/1699] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:28.862732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:28.863277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:28.869653 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:28.870123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:28.870952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:28.871382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:29.003811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:29.012231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0d31eddb-559f-4537-95f9-523e33757eb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153138 Nov 24 18:32:29.012797 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 850/1700] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:28 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:32:30.029213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:30.029873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:30.036038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:30.036481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:30.037242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:30.037671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:30.168781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:30.176606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-36677996-f88f-4e9e-a940-7c2643bd1e89 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151523 Nov 24 18:32:30.177178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 851/1701] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:31.193865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:31.194485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:31.202040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:31.202510 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:31.203267 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:31.203698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:31.331422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:31.339233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-896cec7f-7e78-46d4-8bdf-a48058db88b0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148894 Nov 24 18:32:31.339816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 851/1702] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:32.355783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:32.356393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:32.362882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:32.363334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:32.364115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:32.364552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:32.509308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:32.517076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14b819b6-1f9f-41ea-941d-dd9a29f9bd1d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.165523 Nov 24 18:32:32.517635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 852/1703] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:32:33.533407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:33.534167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:33.540629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:33.541144 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:33.542657 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:33.543290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:33.674344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:33.682115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b64cf895-abe3-4ad9-9f6a-704a730b07c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152285 Nov 24 18:32:33.682671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 852/1704] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:33 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:34.699563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:34.700149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:34.706386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:34.720064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:34.720064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:34.720064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:34.842675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:34.850435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-34e7b073-e88d-4974-9314-34d0902426ae tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155311 Nov 24 18:32:34.851032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 853/1705] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:34 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:35.046447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:32:35.046650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:32:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:32:35.867299 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:35.868739 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:35.875412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:35.875851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:35.876644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:35.877077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:36.006746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:36.015052 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-82859f34-dbbf-4c40-ba46-5992cc660b4a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151550 Nov 24 18:32:36.015612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 853/1706] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:37.032929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:37.033532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:37.039759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:37.040459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:37.041222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:37.041648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:37.069493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:32:37.070091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:32:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:32:37.176094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:37.184885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1e759e8-df31-4138-aa79-69fd63b32a23 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155639 Nov 24 18:32:37.185406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 854/1707] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:38.202116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:38.202734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:38.209075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:38.209524 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:38.210335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:38.210768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:38.338806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:38.346596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-59aa9286-6661-4113-a969-aef14a2c2766 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148798 Nov 24 18:32:38.347160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 854/1708] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:39.363975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:39.364544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:39.371392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:39.371828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:39.372615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:39.373048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:39.501155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:39.508870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ce059fb-7860-4e21-a500-f026375aa1c9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148629 Nov 24 18:32:39.509438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 855/1709] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:40.526368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:40.526991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:40.533008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:40.533453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:40.534260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:40.534694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:40.664678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:40.672658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0b66856b-4291-41d9-8542-c3097d03a6df tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150101 Nov 24 18:32:40.673216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 855/1710] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:40 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:41.690002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:41.690734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:41.696662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:41.697110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:41.697913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:41.698757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:41.829157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:41.836912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab2a4444-fae4-4923-a924-ed4a712819c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150594 Nov 24 18:32:41.837480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 856/1711] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:42.856219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:42.856776 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:42.863027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:42.863472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:42.864237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:42.864668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:42.995071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:43.002832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9e8114d0-7c6e-461b-a018-c345e4ede9c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150929 Nov 24 18:32:43.003392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 856/1712] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:44.019855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:44.020463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:44.027203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:44.027648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:44.028418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:44.028848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:44.156289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:44.163891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-26d5f540-d13d-4eda-ba14-c59e23d0f272 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147626 Nov 24 18:32:44.164458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 857/1713] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:45.181270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:45.181915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:45.188061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:45.188502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:45.189255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:45.189690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:45.320461 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:45.328908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-00dd4635-3059-4432-adce-57e9314aa6e5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151212 Nov 24 18:32:45.329470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 857/1714] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:46.345584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:46.346157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:46.352590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:46.353042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:46.353914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:46.354383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:46.499800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:46.507658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dc685480-b93d-47f0-a95b-edf2bb7485a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.165936 Nov 24 18:32:46.508231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 858/1715] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:47.525160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:47.525796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:47.532648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:47.533093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:47.533902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:47.534373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:47.660221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:47.668255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b780c591-90ec-47cb-ba07-4f8529b95953 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146554 Nov 24 18:32:47.668758 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 858/1716] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:47 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:48.684396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:48.685007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:48.691247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:48.691711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:48.692474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:48.692910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:48.819934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:48.827571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5a264b2-d15f-4e4f-a2b9-20f9d1c6fc00 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147083 Nov 24 18:32:48.828135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 859/1717] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:49.845333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:49.845913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:49.852141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:49.852587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:49.853357 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:49.853815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:49.984652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:49.992264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e136aa08-e5dc-49e0-a8be-80cd4b2525c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150687 Nov 24 18:32:49.992805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 859/1718] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:51.009442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:51.010091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:51.016930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:51.017379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:51.018193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:51.018632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:51.145420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:51.153118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6d34ebaf-34e1-4b96-8fb9-523cd798e289 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147318 Nov 24 18:32:51.153681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 860/1719] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:52.171709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:52.459202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:52.459202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:52.459202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:52.459202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:52.460183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:52.460183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:52.460183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6be04a31-99c6-441f-a4ff-577f4d58de4c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.161429 Nov 24 18:32:52.460183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 860/1720] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:53.345734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:53.346346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:53.352786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:53.353169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:53.353977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:53.354415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:53.507767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:53.516505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dd77e47a-bfb3-463f-a586-2901ed2d8fa3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.174473 Nov 24 18:32:53.517067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 861/1721] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:54.532410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:54.533588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:54.540179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:54.540622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:54.541385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:54.541836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:54.669675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:54.677240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c464329f-55c8-4d45-b227-7e3dad7f6d74 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148369 Nov 24 18:32:54.677826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 861/1722] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:54 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:55.694629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:55.695358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:55.701609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:55.702121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:55.702892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:55.703324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:55.834652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:55.842905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9af061cb-cb69-4948-ad39-f5e3161c1dfe tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151937 Nov 24 18:32:55.843475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 862/1723] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:55 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:56.859494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:56.860102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:56.866301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:56.866744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:56.867511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:56.867965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:56.999635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:57.007370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b080e6aa-4bfb-4dc5-a7ed-d802b9a43ea3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151571 Nov 24 18:32:57.007942 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 862/1724] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:58.024897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:58.025513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:58.032422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:58.032874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:58.033681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:58.034148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:58.164231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:58.172704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-54557630-9249-4c41-9bb9-b955751e6f7e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151532 Nov 24 18:32:58.173267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 863/1725] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:32:59.190150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:32:59.190707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:32:59.197098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:59.197569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:59.198369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:32:59.198805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:32:59.325549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:32:59.333209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cda74d31-6af5-4f2d-8a13-339cd18514c8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146747 Nov 24 18:32:59.333800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 863/1726] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:32:59 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:00.350476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:00.351090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:00.357455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:00.357943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:00.358720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:00.359159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:00.492249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:00.500473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-703c897e-0a85-4181-bf5a-947081a24cd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153618 Nov 24 18:33:00.500980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 864/1727] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:01.516836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:01.517446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:01.523727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:01.524180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:01.524953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:01.525393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:01.655996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:01.663718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6ccfcdf7-e809-40cf-92ca-88763db463ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150530 Nov 24 18:33:01.664270 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 864/1728] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:01 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:02.680764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:02.681384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:02.687886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:02.688338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:02.689116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:02.689556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:02.819611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:02.827628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-50a76971-5b6e-4141-8e21-6b0660696eb9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150445 Nov 24 18:33:02.828205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 865/1729] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:03.844596 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:03.845130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:03.851575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:03.852025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:03.852800 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:03.853235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:03.994220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:04.002954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d03c943-2b1e-4efe-91ce-d3a3f922f26a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.161903 Nov 24 18:33:04.003734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 865/1730] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:05.022377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:05.023099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:05.029641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:05.030123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:05.030906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:05.031343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:05.160176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:05.168137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-13f27eec-9bf9-4f1d-9852-dc8a14cd19b7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149282 Nov 24 18:33:05.169330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 866/1731] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:06.185582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:06.186214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:06.192460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:06.192901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:06.193664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:06.194117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:06.322046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:06.329678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-163dff0a-0186-4621-8e59-e66dbec63150 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148605 Nov 24 18:33:06.330275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 866/1732] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:06 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:07.346104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:07.350454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:07.353100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:07.353575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:07.354374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:07.354800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:07.485543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:07.493310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-37b23895-f2be-44fd-ba85-7b365c04a9bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150796 Nov 24 18:33:07.494592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 867/1733] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:07 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:33:08.510644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:08.511247 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:08.518034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:08.518483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:08.519258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:08.519691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:08.650778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:08.659102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1a3b83a1-ec96-4c2a-9657-c3b466d5be0b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152157 Nov 24 18:33:08.659664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 867/1734] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:08 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:33:09.676098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:09.676706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:09.682934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:09.683372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:09.685071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:09.685510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:09.819045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:09.826846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02c5d265-483c-45df-818a-bcf7b543a252 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154471 Nov 24 18:33:09.827405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 868/1735] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:10.844164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:10.844723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:10.850668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:10.851112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:10.851884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:10.852314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:10.979589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:10.987386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-739f7749-a352-4f54-b0cc-5db83ec63834 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147576 Nov 24 18:33:10.987954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 868/1736] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:12.004835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:12.005451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:12.012558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:12.013007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:12.013820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:12.014399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:12.141986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:12.149546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aece2b7d-41a8-4fd8-bf91-d0d321062dda tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148464 Nov 24 18:33:12.150132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 869/1737] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:13.166640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:13.167246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:13.173507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:13.174029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:13.174785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:13.175217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:13.305670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:13.313473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-914e3af3-19c6-4c8d-a67f-5d22996f8d01 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150864 Nov 24 18:33:13.314082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 869/1738] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:13 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:14.330180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:14.330797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:14.337143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:14.337598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:14.338409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:14.338841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:14.470084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:14.477965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9c46e99-68bf-4fcf-b844-a1ce87063c13 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151359 Nov 24 18:33:14.478538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 870/1739] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:14 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:15.495141 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:15.495812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:15.502756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:15.503213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:15.503988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:15.504426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:15.634199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:15.643108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-373b58ad-26f2-41e4-981d-69ed53008644 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151655 Nov 24 18:33:15.643673 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 870/1740] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:15 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:16.660249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:16.660851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:16.667267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:16.667709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:16.669171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:16.669598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:16.801105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:16.809862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-22bf4454-4b71-49bd-a0e9-735efbad3b63 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152078 Nov 24 18:33:16.810439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 871/1741] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:17.827026 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:17.827562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:17.833740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:17.834220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:17.835002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:17.835439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:17.965986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:17.973699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b0885907-7119-49ec-a650-8387801b17c2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150932 Nov 24 18:33:17.974304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 871/1742] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:18.992120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:18.992763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:18.999059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:18.999508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:19.000276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:19.000741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:19.125211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:19.132812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2bcf0e8c-9166-41f5-8a95-fa4f34faa2ee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.144383 Nov 24 18:33:19.133381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 872/1743] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:20.150509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:20.152778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:20.158961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:20.159403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:20.160161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:20.160588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:20.287901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:20.296028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2b393d84-f094-4880-84e3-220db39e230c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149234 Nov 24 18:33:20.296587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 872/1744] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:20 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:21.313406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:21.314047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:21.320296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:21.320735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:21.321509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:21.321984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:21.451724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:21.459390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7ace89f9-89f6-4d72-91f7-094ad66a69a6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149638 Nov 24 18:33:21.462785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 873/1745] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:21 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:22.476236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:22.476853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:22.483262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:22.483714 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:22.484496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:22.484931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:22.616218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:22.624661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f41d0bb0-0966-425c-a192-63dda40bf468 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152091 Nov 24 18:33:22.625231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 873/1746] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:22 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:23.641040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:23.641680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:23.647994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:23.648443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:23.649218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:23.649657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:23.778182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:23.785874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c14e5bad-7338-4342-89c2-751fcd1b8c5f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148588 Nov 24 18:33:23.786469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 874/1747] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:24.802759 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:24.803364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:24.810069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:24.810511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:24.811399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:24.811874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:24.946403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:24.955761 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a4ca8adf-53f3-4f70-a744-efcc194f1560 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156564 Nov 24 18:33:24.956338 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 874/1748] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:25.973358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:25.974000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:25.981407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:25.981889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:25.982674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:25.983109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:26.117036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:26.125517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6cf1ab66-6cba-4e37-8532-6dff7f280a39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156007 Nov 24 18:33:26.126116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 875/1749] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:27.142226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:27.142856 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:27.151149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:27.151149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:27.151149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:27.151149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:27.279155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:27.286795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7fada2a5-71d1-4a38-876f-34be62f31c5e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148368 Nov 24 18:33:27.287360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 875/1750] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:28.304177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:28.304713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:28.311025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:28.311475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:28.312250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:28.312687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:28.438104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:28.445781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-432b4368-f4fe-4351-853b-257334ff0f73 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.145371 Nov 24 18:33:28.446356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 876/1751] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:28 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:29.461902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:29.462520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:29.469726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:29.470211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:29.470989 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:29.471426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:29.603044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:29.611049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4c58ef19-610d-49b1-941f-f5a4f2b2ee82 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152742 Nov 24 18:33:29.611613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 876/1752] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:29 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:30.627817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:30.628428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:30.634772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:30.635218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:30.635984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:30.636417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:30.766486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:30.774139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4a3d3cf5-ad9e-42d2-abbb-8e7ad8f3189d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150020 Nov 24 18:33:30.774708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 877/1753] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:31.791274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:31.791936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:31.798616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:31.799065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:31.799835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:31.800269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:31.928167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:31.936483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8c5acef4-1711-4942-b044-a4c68b2b571a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149100 Nov 24 18:33:31.937054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 877/1754] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:32.952296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:32.952921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:32.959096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:32.959537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:32.960294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:32.960719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:33.088179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:33.096793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9a37b684-f767-454a-a058-d5b49119d157 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148332 Nov 24 18:33:33.097369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 878/1755] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:34.113903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:34.114517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:34.121904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:34.122360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:34.123138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:34.123574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:34.250622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:34.258229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dae2f47b-383f-4023-955f-f4c794b851f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148190 Nov 24 18:33:34.258808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 878/1756] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:34 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:35.275899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:35.276542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:35.283490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:35.283933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:35.284697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:35.285127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:35.412198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:35.421192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2788e98e-77ba-4c19-ac68-6bb47d11cc71 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148888 Nov 24 18:33:35.430424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 879/1757] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:36.437947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:36.438695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:36.444937 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:36.445416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:36.446304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:36.446748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:36.590200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:36.598783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-32587ddf-e26f-46b8-9aa9-3fb03a12e424 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.164906 Nov 24 18:33:36.601434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 879/1758] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:36 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:37.617017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:37.617640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:37.624037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:37.624484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:37.625292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:37.625712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:37.758629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:37.766938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-248d7a5e-3486-4a00-b85d-64f42931b07e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153574 Nov 24 18:33:37.767502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 880/1759] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:38.784071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:38.784678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:38.791869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:38.792261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:38.793049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:38.793483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:38.921068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:38.928679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fdac998a-ee66-450f-b157-2a02cd819b68 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148288 Nov 24 18:33:38.929230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 880/1760] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:39.945529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:39.946178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:39.952165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:39.952613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:39.953392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:39.953857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:40.080445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:40.088128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42033282-9e5c-46d2-ad08-b773204c21a1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146404 Nov 24 18:33:40.088698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 881/1761] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:41.105682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:41.106730 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:41.112194 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:41.112635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:41.113394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:41.113848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:41.242551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:41.250896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9bf142d0-b92f-4edf-846a-bdf2665f5902 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148976 Nov 24 18:33:41.251458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 881/1762] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:42.268374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:42.268982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:42.275226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:42.275674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:42.276444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:42.276874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:42.406406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:42.414300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e35d955c-b61d-4dbe-8bb0-fa353277e7a4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149791 Nov 24 18:33:42.414869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 882/1763] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:43.431905 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:43.432512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:43.439439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:43.439893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:43.440671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:43.441110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:43.571340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:43.579223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1c8dad6c-3d99-4349-b1e3-eaab3475c1bc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150997 Nov 24 18:33:43.579788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 882/1764] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:43 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:44.596140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:44.596742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:44.602937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:44.603379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:44.604139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:44.604565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:44.737194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:44.745078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e0277b9-4543-49c6-b2ee-937b787e5fa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152578 Nov 24 18:33:44.745655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 883/1765] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:45.762554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:45.763169 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:45.769601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:45.770076 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:45.770855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:45.771289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:45.910619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:45.919213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-90322034-0083-42e2-82d2-58b60a1a2a50 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.159716 Nov 24 18:33:45.921959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 883/1766] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:33:46.945478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:46.946117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:46.952481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:46.952937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:46.953719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:46.954216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:47.096531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:47.104281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7efe64b7-f42b-4062-9962-a14dd55f8b7c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.162448 Nov 24 18:33:47.104865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 884/1767] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:48.121117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:48.121863 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:48.129036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:48.129802 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:48.130775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:48.131211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:48.261455 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:48.270000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ffa7a25c-9fb7-44f9-a12f-f0db537a29a8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152356 Nov 24 18:33:48.270582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 884/1768] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:49.286904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:49.287518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:49.294178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:49.294567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:49.295404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:49.295766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:49.424359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:49.432019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2f703e38-e849-4dc6-a205-4a9cf5ca01c0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148839 Nov 24 18:33:49.432585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 885/1769] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:49.563238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:33:49.563740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:33:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:33:50.410666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:33:50.411146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:33:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:33:50.449145 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:50.449755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:50.456701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:50.457148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:50.457987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:50.458452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:50.587069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:50.595589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-922012e5-c3d7-4083-81a5-86a90d037063 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150047 Nov 24 18:33:50.596142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 885/1770] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:50 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:51.612996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:51.613607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:51.620147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:51.620599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:51.621383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:51.621847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:51.755310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:51.763037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-943fbd9e-6994-4ff3-a477-d1709a6e1942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153684 Nov 24 18:33:51.763634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 886/1771] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:52.779573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:52.780185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:52.786537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:52.786986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:52.787757 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:52.788196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:52.918335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:52.926442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a0030665-5da3-4c6b-9087-69ed314a7ec6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150599 Nov 24 18:33:52.927003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 886/1772] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:53.943677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:53.944379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:53.950573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:53.951535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:53.952314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:53.952751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:54.086469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:54.095476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77c8c43a-d35c-4728-b1f5-e45196410e15 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155406 Nov 24 18:33:54.096057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 887/1773] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:55.113627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:55.114281 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:55.120607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:55.121059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:55.121861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:55.122297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:55.249492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:55.257185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7a0738d-a4a7-4ae4-8b09-29af3aa3a13b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147233 Nov 24 18:33:55.257747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 887/1774] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:55 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:56.274982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:56.275615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:56.282811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:56.283341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:56.284035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:56.284474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:56.413048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:56.421539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0fd450dd-f4c3-472d-8cb2-940b1e3a7e03 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149654 Nov 24 18:33:56.422165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 888/1775] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:57.439274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:57.439866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:57.446745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:57.446745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:57.447360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:57.447795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:57.589798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:57.597597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5cb0d483-ef3b-4abe-b04e-e7cd16a73a6a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.162940 Nov 24 18:33:57.598191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 888/1776] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:57 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:58.615039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:58.615652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:58.621817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:58.622272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:58.623050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:58.623520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:58.754585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:58.762404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ac715e8d-dc6f-42a2-9aa9-07faccb15555 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151602 Nov 24 18:33:58.762973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 889/1777] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:59.779883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:59.780569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:33:59.786809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:59.787253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:59.788007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:33:59.788702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:33:59.915720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:59.923535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-13bb7797-d7a9-4278-86a6-5e575f52a464 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147329 Nov 24 18:33:59.924104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 889/1778] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:59 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:00.939764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:00.940380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:00.946599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:00.947041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:00.947804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:00.948232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:01.075303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:01.083829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cbcaa6f8-3859-4cf0-b421-da294d67d5da tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147960 Nov 24 18:34:01.084407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 890/1779] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:02.101188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:02.101722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:02.108750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:02.109210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:02.110009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:02.110442 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:02.236289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:02.243873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2387e1c2-114a-40a6-897f-6e415499384a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146379 Nov 24 18:34:02.244437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 890/1780] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:03.260756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:03.261400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:03.268032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:03.268488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:03.269262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:03.269698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:03.395872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:03.403547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab0af108-f3de-4b29-94e3-01ed5b267ee6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146476 Nov 24 18:34:03.404110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 891/1781] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:04.421409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:04.422061 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:04.428298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:04.428782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:04.429561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:04.430030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:04.560632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:04.569552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fac9ce0c-2689-4053-83cd-83bfa8bcdf11 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152146 Nov 24 18:34:04.570147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 891/1782] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:04 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:05.586717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:05.587327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:05.594363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:05.594800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:05.595566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:05.595993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:05.970432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:05.978190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4649c6ed-9604-4aa1-930b-8437b0ee407d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.395103 Nov 24 18:34:05.978865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 892/1783] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:06.995019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:06.995631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:07.002566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:07.003011 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:07.003780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:07.004209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:07.132287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:07.140342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-30a83bd7-01a3-4f5c-b91e-db7f7ee8bf8a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148594 Nov 24 18:34:07.142670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 892/1784] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:06 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:07.225030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:34:07.225213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:34:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:34:08.157378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:08.158022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:08.164483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:08.164935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:08.165704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:08.166167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:08.293929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:08.302084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c2af3911-3500-463a-a289-d877d6a7d54c tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148309 Nov 24 18:34:08.302643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 893/1785] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:08 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:09.318783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:09.319329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:09.325468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:09.325950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:09.326712 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:09.327143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:09.457015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:09.464668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f90249b2-9825-4e61-9533-30b03bbe8afd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149563 Nov 24 18:34:09.465263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 893/1786] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:10.481922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:10.482537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:10.489475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:10.489969 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:10.490750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:10.491191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:10.527881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:34:10.528091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:34:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff (ip 10.222.0.53) !!! Nov 24 18:34:10.623204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:10.631823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb446a89-74d7-4885-a1cd-697fbab2dcd7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153518 Nov 24 18:34:10.632397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 894/1787] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:11.649296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:11.649949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:11.656240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:11.656688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:11.657453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:11.657912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:11.788819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:11.800005 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ad3c5e6e-bf9f-4ef9-a1bd-97c720911bb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154421 Nov 24 18:34:11.800670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 894/1788] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:12.817662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:12.818259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:12.824856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:12.825292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:12.826093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:12.826520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:12.952244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:12.960003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-75ba1a20-f30a-44ea-a120-554e504d0304 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146039 Nov 24 18:34:12.960574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 895/1789] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:12 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:13.976284 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:13.976891 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:13.983185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:13.983675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:13.984549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:13.984983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:14.113062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:14.120727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c62e2c78-3442-44a9-a75b-58dabf84e832 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148179 Nov 24 18:34:14.121289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 895/1790] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:13 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:15.138501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:15.139097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:15.146298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:15.146754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:15.147523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:15.147967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:15.279069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:15.287687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0103127c-897e-4935-83b3-1734939150cf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152751 Nov 24 18:34:15.288517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 896/1791] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:15 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:16.304090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:16.304706 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:16.310963 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:16.311421 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:16.312765 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:16.313200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:16.443013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:16.450745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-898064e7-461d-4c49-91da-1508bb48ec14 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150297 Nov 24 18:34:16.451309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 896/1792] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:17.468899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:17.469561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:17.476158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:17.476615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:17.477399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:17.477868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:17.610290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:17.617935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d68753c7-aeab-47f6-8f30-febd063c8dc5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153472 Nov 24 18:34:17.618500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 897/1793] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:18.634984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:18.635597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:18.642572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:18.643017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:18.643794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:18.644231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:18.770816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:18.778479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2651e482-89a3-428b-b42f-8322f2d86efb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147106 Nov 24 18:34:18.779031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 897/1794] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:19.796997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:19.797540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:19.803735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:19.804181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:19.804971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:19.805391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:19.932080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:19.939754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be08ffec-b105-44b5-846f-df157cafcfe0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147334 Nov 24 18:34:19.940319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 898/1795] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:19 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:20.957021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:20.957642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:20.963921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:20.964378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:20.965155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:20.965593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:21.093791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:21.101484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e255c369-3df6-42ab-883b-bdeb2e3d4aa4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148186 Nov 24 18:34:21.102106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 898/1796] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:20 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:22.118523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:22.119135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:22.126078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:22.126530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:22.127306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:22.127742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:22.259907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:22.267845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cfae707a-d45f-4fad-8cc9-b0b2eff63267 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152951 Nov 24 18:34:22.268413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 899/1797] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:22 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:23.284454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:23.285085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:23.291729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:23.292179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:23.292950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:23.293386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:23.421729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:23.429368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2af85153-ef98-4c89-bdb3-f7d3b890214a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148534 Nov 24 18:34:23.429961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 899/1798] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:24.447374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:24.447984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:24.458174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:24.458620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:24.459406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:24.460185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:24.589514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:24.597784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-935a4d56-deaa-4a1a-a5c9-4402223265b3 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154053 Nov 24 18:34:24.598361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 900/1799] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:25.614187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:25.614794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:25.621168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:25.621620 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:25.622456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:25.622897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:25.752807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:25.760537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3798af31-9aa7-4fdd-840d-56644a087783 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150018 Nov 24 18:34:25.761100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 900/1800] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:26.778116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:26.778745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:26.785390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:26.785872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:26.786641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:26.787071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:26.919961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:26.927700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6f2eb18-25af-417e-b205-63c1b1b1f97f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153316 Nov 24 18:34:26.928262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 901/1801] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:26 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:27.947542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:27.948746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:27.955820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:27.956263 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:27.957043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:27.957469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:28.101288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:28.109300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5b9285f6-a4ef-41d2-be00-d3f4762045dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.166058 Nov 24 18:34:28.109880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 901/1802] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:29.126175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:29.126780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:29.133004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:29.133442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:29.134223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:29.134653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:29.261118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:29.269439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aa46a3cd-4d84-48d2-a93a-1a66ee69c330 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147180 Nov 24 18:34:29.270107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 902/1803] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:29 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:30.286836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:30.287410 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:30.293931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:30.294379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:30.295153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:30.295631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:30.420820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:30.428563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-caffff06-dfac-4124-a976-395e7ccf21bb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.145427 Nov 24 18:34:30.429140 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 902/1804] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:31.447921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:31.448520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:31.455481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:31.455927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:31.456705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:31.457138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:31.586280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:31.594809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fc453c79-fd63-4a1f-b60e-dbf9ee0814dd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151007 Nov 24 18:34:31.595384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 903/1805] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:34:32.611774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:32.612787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:32.620972 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:32.621446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:32.622271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:32.622703 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:32.978508 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:32.986813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6b3f9bbf-3978-4006-9e0f-721c5f8d3965 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.378757 Nov 24 18:34:32.987381 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 903/1806] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:34.004185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:34.004798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:34.011180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:34.011629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:34.012402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:34.012836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:34.146735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:34.154311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-843133aa-8075-4b59-a507-86ab63df98e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153811 Nov 24 18:34:34.154967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 904/1807] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:33 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:35.177416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:35.178065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:35.184533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:35.184984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:35.185779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:35.186527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:35.314541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:35.322441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0c7199cf-8f78-45c8-8a87-e19aea0f1f3d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148687 Nov 24 18:34:35.327116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 904/1808] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:36.339423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:36.340102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:36.347206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:36.347659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:36.348446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:36.348878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:36.486859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:36.494478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f9ed292-e868-4b39-a59c-5e2aaeb057f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.158653 Nov 24 18:34:36.495045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 905/1809] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:36 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:37.511151 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:37.511771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:37.518273 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:37.518749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:37.519528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:37.520000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:37.649097 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:37.656807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9f834ac4-7bea-4231-bf18-621947102bb6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149365 Nov 24 18:34:37.657371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 905/1810] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:38.674066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:38.674682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:38.680920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:38.681366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:38.682176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:38.682612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:38.815249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:38.823014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-11a4e7ee-8afa-47a0-92cc-3fc50548667f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152689 Nov 24 18:34:38.823588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 906/1811] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:39.840020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:39.840573 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:39.846933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:39.847375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:39.848136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:39.848561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:39.976004 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:39.984379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6f367b2c-9304-4147-8628-d983d8aab08a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148084 Nov 24 18:34:39.984941 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 906/1812] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:41.001807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:41.002414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:41.008293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:41.008733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:41.009489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:41.009946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:41.138815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:41.147401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d0a82c09-748e-4580-a3ba-12058af37791 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149962 Nov 24 18:34:41.147976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 907/1813] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:40 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:42.165147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:42.165750 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:42.172002 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:42.172443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:42.173200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:42.173648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:42.300748 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:42.308564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6e3eb03b-9c8c-4318-909f-a51d348863ec tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147554 Nov 24 18:34:42.309383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 907/1814] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:43.326966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:43.327567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:43.333784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:43.334251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:43.335005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:43.335436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:43.465790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:43.474207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-617f245c-a531-45d2-b480-3c17ac76cfc7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151287 Nov 24 18:34:43.474782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 908/1815] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:43 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:44.491526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:44.492138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:44.499521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:44.500012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:44.500789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:44.501254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:44.628814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:44.636469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-57440202-ddf5-4320-bd95-b7e3b79c1acf tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148636 Nov 24 18:34:44.637025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 908/1816] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:45.653876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:45.654513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:45.660777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:45.661226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:45.662028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:45.662732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:45.802493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:45.813724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7b5101b3-08e9-44a1-9021-6f038e5db977 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.160098 Nov 24 18:34:45.813724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 909/1817] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:46.828950 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:46.829567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:46.835886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:46.836329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:46.837104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:46.837531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:46.972926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:46.980642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-edef9a36-165e-454a-a25a-119a6f3c6fd1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156053 Nov 24 18:34:46.981200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 909/1818] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:47.997649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:47.999122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:48.005648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:48.006125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:48.006882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:48.007309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:48.132993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:48.141273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e92d48d8-f937-415d-978b-59e3a4d5f397 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147293 Nov 24 18:34:48.141853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 910/1819] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:47 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:49.158339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:49.158868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:49.165239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:49.165681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:49.166492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:49.166918 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:49.297006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:49.304933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2781e3fd-84ee-45d1-a6fa-614a36d8fa28 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150729 Nov 24 18:34:49.305532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 910/1820] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:50.321888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:50.322549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:50.330225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:50.330672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:50.331442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:50.331878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:50.464400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:50.472680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6760034e-f69a-40f4-aaf3-c43a0a34b4e0 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154489 Nov 24 18:34:50.473250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 911/1821] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:50 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:51.489209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:51.489877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:51.496215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:51.496661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:51.497519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:51.497978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:51.632206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:51.640635 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-797bfded-2f66-48c5-a9ce-234d456f5a85 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155107 Nov 24 18:34:51.641211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 911/1822] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:52.658552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:52.659073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:52.665553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:52.666035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:52.666814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:52.667253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:52.796939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:52.804641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b48278cc-45e3-4457-93a7-0db64b2e9bab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150019 Nov 24 18:34:52.805211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 912/1823] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:53.822520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:53.823156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:53.830268 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:53.830718 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:53.831516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:53.831947 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:53.962135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:53.970087 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-05c53b8c-3726-41cb-8c40-6da1e1cfc8fb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151316 Nov 24 18:34:53.970660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 912/1824] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:54.986460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:54.987078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:54.993345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:54.993826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:54.994607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:54.995050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:55.127031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:55.134668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a36eddb2-297f-4006-b46e-869346d2265b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151909 Nov 24 18:34:55.135239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 913/1825] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:54 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:34:56.152347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:56.152988 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:56.159775 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:56.166935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:56.166935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:56.166935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:56.291597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:56.299437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ba741869-50f7-43ca-884a-af01ae643299 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150753 Nov 24 18:34:56.300030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 913/1826] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:57.316152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:57.316759 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:57.322949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:57.323389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:57.324181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:57.324898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:57.465518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:57.473960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-282b60c8-bcc7-4c2e-a1d2-67e0c0fe6307 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.161576 Nov 24 18:34:57.474518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 914/1827] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:57 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:58.490415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:58.491027 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:58.497246 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:58.497692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:58.499075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:58.499511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:58.630474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:58.638154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-06299774-6352-48f3-949f-11e178f206cb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151295 Nov 24 18:34:58.638713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 914/1828] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:34:59.655496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:34:59.656044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:34:59.662689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:59.663140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:59.663921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:34:59.664361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:34:59.790407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:34:59.798170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-433d2cc4-17d3-4c28-9565-dd825b0c072e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146403 Nov 24 18:34:59.798746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 915/1829] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:34:59 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:00.815738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:00.816354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:00.822675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:00.823064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:00.823838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:00.824275 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:01.007327 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:01.015001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-82baa57b-04f8-4389-a0e9-27c01cd20ee7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.203734 Nov 24 18:35:01.015565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 915/1830] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:02.033433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:02.034155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:02.041310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:02.041880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:02.042809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:02.043249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:02.232028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:02.239843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e416847-7f40-4c98-b44e-5effbafe166f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.211062 Nov 24 18:35:02.240411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 916/1831] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:03.257248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:03.257904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:03.264370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:03.264812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:03.265584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:03.266044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:03.391521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:03.399380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7a99b0d2-df79-4822-b433-3844e50e4b25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.145745 Nov 24 18:35:03.400078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 916/1832] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:04.416148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:04.416765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:04.423207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:04.423813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:04.424596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:04.425037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:04.554111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:04.561897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e649c4ce-eb03-4a48-8b3d-44e9621fd57f tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149616 Nov 24 18:35:04.562468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 917/1833] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:04 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:05.578677 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:05.579922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:05.586897 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:05.587347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:05.588119 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:05.588554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:05.723126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:05.731186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e153170a-9a05-450d-83cc-d6bf034322ca tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156211 Nov 24 18:35:05.731722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 917/1834] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:35:06.748281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:06.748926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:06.756879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:06.757333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:06.758155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:06.758590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:06.895825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:06.904351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ddff2ce2-49ca-4dd0-ac96-e7b8dacce403 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.159883 Nov 24 18:35:06.905000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 918/1835] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:06 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:07.931236 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:07.931871 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:07.940028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:07.940444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:07.941459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:07.941936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:08.081208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:08.088932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-875f5ff1-5b26-4075-b1a2-475ca7b96ca5 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.161424 Nov 24 18:35:08.089499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 918/1836] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:07 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:09.105708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:09.106369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:09.112536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:09.112986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:09.113755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:09.114216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:09.240424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:09.248147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f96e33f6-6448-4d92-8cd4-fb3c4063b7e2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146114 Nov 24 18:35:09.248721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 919/1837] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:10.265210 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:10.265851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:10.271737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:10.272186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:10.272961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:10.273399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:10.406003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:10.414607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fbec6bd6-4b89-4553-bb48-8b98d43ceb62 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153257 Nov 24 18:35:10.415176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 919/1838] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:10 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:11.432206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:11.432819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:11.438986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:11.439455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:11.440563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:11.441008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:11.575254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:11.583530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83fc7c55-1e7b-4ac2-8edd-4531bd3b8cf4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155142 Nov 24 18:35:11.584129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 920/1839] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:11 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:12.600503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:12.601038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:12.607226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:12.607667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:12.608436 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:12.608863 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:12.736559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:12.744350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-22e9c46c-369f-47f0-8a64-abb16de43e79 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147556 Nov 24 18:35:12.744921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 920/1840] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:12 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:13.762136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:13.762730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:13.769620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:13.770097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:13.770872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:13.771310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:13.900626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:13.908501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ec1bf294-8feb-4599-b23b-4219a8af1dfb tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150067 Nov 24 18:35:13.909098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 921/1841] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:13 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:14.926077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:14.926691 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:14.932936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:14.933386 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:14.934213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:14.934630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:15.064003 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:15.071611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4bc2b360-05e4-4493-9d55-a8c122d30651 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149904 Nov 24 18:35:15.072167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 921/1842] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:14 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:16.088721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:16.089339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:16.095596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:16.096046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:16.096820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:16.097259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:16.223964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:16.237208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cde8c868-455f-4fd3-b5fe-4f485f114478 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146568 Nov 24 18:35:16.237208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 922/1843] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:16 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:17.248074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:17.248692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:17.255875 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:17.256334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:17.257120 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:17.257559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:17.394623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:17.402301 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5d333b0c-17db-415e-8859-0a8e70ca61f9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.157911 Nov 24 18:35:17.402855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 922/1844] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:17 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:35:18.419563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:18.420176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:18.426483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:18.426894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:18.427680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:18.428119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:18.563506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:18.572102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-406cb4f9-a233-4eac-8523-68978e59fc25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156093 Nov 24 18:35:18.572708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 923/1845] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:18 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:19.589309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:19.589969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:19.596170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:19.596557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:19.597936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:19.598363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:19.724288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:19.731857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1c697dfa-45cd-460f-b24b-6c6985b64c35 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146146 Nov 24 18:35:19.732420 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 923/1846] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:19 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:20.747967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:20.748579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:20.754948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:20.755395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:20.756175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:20.756611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:20.884722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:20.893129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d0947e93-8a06-4b28-8f76-42781f9c1db1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148802 Nov 24 18:35:20.894228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 924/1847] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:20 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:21.910814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:21.911423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:21.917893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:21.918334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:21.919096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:21.919522 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:22.048933 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:22.057083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a3c40ee8-2018-4336-9eb6-30fc9e7b8942 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149981 Nov 24 18:35:22.057645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 924/1848] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:21 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:23.074021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:23.074664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:23.081426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:23.081920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:23.082676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:23.083111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:23.215269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:23.224029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-82933b95-eca2-46f0-99b1-dc3585ababf1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153834 Nov 24 18:35:23.224603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 925/1849] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:23 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:24.242033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:24.242652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:24.248418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:24.248846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:24.249606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:24.250062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:24.376492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:24.384789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c6843cee-1204-454d-8615-2cb3bca6d648 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147777 Nov 24 18:35:24.385356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 925/1850] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:24 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:25.402225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:25.402825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:25.410304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:25.410776 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:25.411553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:25.412243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:25.540782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:25.548489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c4bb2169-b50c-446f-bf3c-d1147fdb2828 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149962 Nov 24 18:35:25.549058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 926/1851] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:25 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:26.565572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:26.566209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:26.572472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:26.572913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:26.573672 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:26.574124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:26.706499 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:26.714813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5d8e385c-e330-43ec-a32a-2ab802ec8b86 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152869 Nov 24 18:35:26.715956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 926/1852] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:26 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:27.732175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:27.732778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:27.739182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:27.739649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:27.740417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:27.740855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:27.871664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:27.880064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cbdd98f3-b106-4534-a1fa-27c70c3555b8 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151510 Nov 24 18:35:27.880820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 927/1853] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:27 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:28.896069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:28.896715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:28.903029 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:28.903481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:28.904682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:28.905154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:29.038876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:29.047325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2182aba6-f382-4e88-9a88-aba48a4da186 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154845 Nov 24 18:35:29.047834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 927/1854] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:28 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:30.067403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:30.068157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:30.074145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:30.074594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:30.075411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:30.075849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:30.208688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:30.216327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5e6b5292-5104-45d5-8d63-80f5beb11a1b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153802 Nov 24 18:35:30.216896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 928/1855] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:30 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:31.233340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:31.233977 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:31.240814 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:31.241265 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:31.242078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:31.242516 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:31.371846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:31.379809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-417e7c74-8987-45d9-af13-0a3811b85963 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150040 Nov 24 18:35:31.380378 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 928/1856] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:31 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:32.396137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:32.396745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:32.403025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:32.403479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:32.404252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:32.404721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:32.532668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:32.540755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7cf93ed5-3d39-4fed-9a46-8505ce82dfee tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148310 Nov 24 18:35:32.541330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 929/1857] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:32 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:33.558494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:33.558494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:33.565388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:33.566628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:33.567451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:33.567886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:33.700981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:33.709482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-544b0183-a58d-4ed2-bb9b-63f079bdbe6e tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.155337 Nov 24 18:35:33.710090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 929/1858] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:33 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:34.726712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:34.727346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:34.733453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:34.733938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:34.734702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:34.735126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:34.866998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:34.874715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a82c28c9-f7d5-44f7-8f1a-9853b6de7f95 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151703 Nov 24 18:35:34.875285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 930/1859] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:34 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:35.892220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:35.892815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:35.899271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:35.899713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:35.900469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:35.900894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:36.031986 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:36.040185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-027cb632-6b78-42bc-9689-9ca2f1224a20 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151618 Nov 24 18:35:36.041093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 930/1860] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:35 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:37.057840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:37.058430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:37.064598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:37.065698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:37.066504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:37.066937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:37.200708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:37.209060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c03ebe27-44fa-4642-81b2-5141397d12ed tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154852 Nov 24 18:35:37.209637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 931/1861] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:37 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:38.226494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:38.227098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:38.233290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:38.233732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:38.234528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:38.234955 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:38.372895 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:38.381087 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e309b5e3-19f6-4654-9678-9554cce58be6 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.158231 Nov 24 18:35:38.381667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 931/1862] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:38 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:39.398221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:39.398824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:39.404847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:39.405285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:39.406069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:39.406499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:39.541515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:39.549439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3842cdb6-bba2-4761-9a25-c79b19f050f1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.154640 Nov 24 18:35:39.550052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 932/1863] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:39 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:40.566425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:40.567038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:40.573006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:40.573459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:40.574539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:40.574973 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:40.703206 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:40.711377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ba56102-1f8c-4e98-8235-0223206d53f7 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148827 Nov 24 18:35:40.711948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 932/1864] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:40 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:41.728118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:41.728763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:41.734591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:41.735042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:41.735813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:41.736252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:41.865975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:41.873715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78270b8f-7e81-42b6-a6c4-0a75413354f2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149505 Nov 24 18:35:41.874309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 933/1865] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:41 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:42.890720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:42.891276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:42.897961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:42.898406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:42.899168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:42.899600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:43.026566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:43.034359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-afd53dc3-8aa7-4e5e-9458-6ed13d4f8e55 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147283 Nov 24 18:35:43.034932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 933/1866] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:42 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:44.051560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:44.052123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:44.058254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:44.058691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:44.059453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:44.059882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:44.187224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:44.195608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4330e1ec-febf-4dd9-9a1c-8bd601f1d69a tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147766 Nov 24 18:35:44.196172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 934/1867] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:44 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:45.212493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:45.213109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:45.219422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:45.219879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:45.220651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:45.221229 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:45.353841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:45.361474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9cd765dd-397c-4ec8-b522-d01bb1fff8f4 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152734 Nov 24 18:35:45.362188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 934/1868] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:45 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:46.377930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:46.378577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:46.384787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:46.385234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:46.386030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:46.386465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:46.519494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:46.527186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48a41f21-c104-46a3-b3e8-d5414c333a57 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153080 Nov 24 18:35:46.527752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 935/1869] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:46 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:47.545114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:47.545723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:47.551915 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:47.552359 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:47.553126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:47.553551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:47.684397 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:47.692581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8184756c-fbc0-49e9-8256-6431dd8485a2 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151160 Nov 24 18:35:47.693137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 935/1870] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:47 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:48.710091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:48.710708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:48.716920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:48.717372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:48.718181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:48.718652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:48.847345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:48.855081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-104c753d-4d5b-467b-9e23-ec1f77af82fa tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.148645 Nov 24 18:35:48.855719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 936/1871] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:48 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:49.872092 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:49.872695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:49.879783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:49.880232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:49.881018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:49.885186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:50.023792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:50.032303 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-65cfe45d-513c-469c-a57d-db112b5b6b08 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.163716 Nov 24 18:35:50.033351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 936/1872] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:49 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:51.050809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:51.051571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:51.057789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:51.058253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:51.059029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:51.059462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:51.194778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:51.202481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27ee7ce8-5e1a-4f7a-b389-feeff13930dc tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.156481 Nov 24 18:35:51.203042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 937/1873] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:51 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:52.220247 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:52.221457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:52.229164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:52.229615 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:52.230423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:52.230865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:52.390046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:52.401894 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f0698b6d-7c68-4fac-b7f9-4a4d0c16318d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.185205 Nov 24 18:35:52.402478 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 937/1874] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:52 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:53.420134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:53.420884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:53.427484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:53.427936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:53.428715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:53.429153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:53.556507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:53.564359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-57638c17-353f-4b53-afda-629fa00a9ed1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147872 Nov 24 18:35:53.565578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 938/1875] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:53 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:54.581601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:54.582317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:54.588474 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:54.588910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:54.589667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:54.590122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:54.715780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:54.724222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7abcbe9b-0558-4a75-a2fc-22bb9e7e6cb1 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.146479 Nov 24 18:35:54.724782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 938/1876] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:54 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:55.064478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:35:55.065030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:35:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:35:55.740582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:55.741195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:55.747522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:55.747966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:55.748737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:55.749306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:55.880333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:55.888224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ce414623-6c68-402a-85b5-d8c3b6745e39 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151768 Nov 24 18:35:55.891158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 939/1877] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:55 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:56.905199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:56.905809 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:56.912763 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:56.913200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:56.913994 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:56.914423 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:57.046832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:57.055187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8566251e-810d-44c6-90e2-dc9aaadcf5ab tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.153612 Nov 24 18:35:57.055755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 939/1878] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:56 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:57.087205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:35:57.087351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:35:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:35:58.072092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:58.072708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:58.079089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:58.079539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:58.080648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:58.080918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:58.207982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:58.215734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-950976a2-fb38-4696-8c19-c8e560532558 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147316 Nov 24 18:35:58.216299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 940/1879] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:58 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:59.232451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:59.233062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:35:59.239595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:59.240044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:59.240816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:35:59.241253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:35:59.371227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:59.379555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ab674c6-eebc-4b4f-9b34-0dfa3d64bde9 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.150806 Nov 24 18:35:59.380108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 940/1880] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:59 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:00.396477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:00.397086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:00.403206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:00.403650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:00.404448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:00.404876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:00.535186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:00.542449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1a2a5f9c-b7aa-4a22-a87c-a721aa42a411 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.149999 Nov 24 18:36:00.543433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 941/1881] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:00 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:01.564812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:01.564812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:01.567401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.567857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:01.568648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.569084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:01.607827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:01.608504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:01.615644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.616097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:01.616891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.617330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:01.642382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:36:01.706048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:01.713741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9e422c23-5a52-46fd-bbc6-a5583079de25 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.157879 Nov 24 18:36:01.714313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 941/1882] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:01 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:01.920705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c294e364-b474-4e37-bf22-cd8eb04f322b tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 204 len: 0 microversion: 2.1 time: 0.316166 Nov 24 18:36:01.921295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 942/1883] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:36:01 2021] DELETE /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:36:01.929588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:01.930228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:01.936223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.936668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:01.941711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:01.941711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:02.066527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:02.073699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fa3b3bae-d345-4570-8d14-1a2cb5fdc179 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1514 microversion: 2.1 time: 0.147736 Nov 24 18:36:02.074295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 942/1884] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:01 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:02.731785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:02.732526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:02.739378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:02.739831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:02.740612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:02.741052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:02.959279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:02.969436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e757ffe7-bde9-49e0-b0a4-de0c58563ede tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.241757 Nov 24 18:36:02.970062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 943/1885] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:02 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:03.012913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [req-675c41bf-d8cb-467e-bc7c-28fbaa4f5ddb req-2c97b30b-c63d-4fac-ba63-ab752135d384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae5c20f-69b8-4965-9dfc-332eb4e2eb7b", "name": "network-vif-deleted", "tag": "b50f648a-1dfb-44f2-b30f-48daa153739b"}]} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:36:03.014731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:36:03.014731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: warnings.warn(msg) Nov 24 18:36:03.021733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-675c41bf-d8cb-467e-bc7c-28fbaa4f5ddb req-2c97b30b-c63d-4fac-ba63-ab752135d384 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:03.022193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [req-675c41bf-d8cb-467e-bc7c-28fbaa4f5ddb req-2c97b30b-c63d-4fac-ba63-ab752135d384 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:03.033676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.compute.server_external_events [req-675c41bf-d8cb-467e-bc7c-28fbaa4f5ddb req-2c97b30b-c63d-4fac-ba63-ab752135d384 service nova] Creating event network-vif-deleted:b50f648a-1dfb-44f2-b30f-48daa153739b for instance eae5c20f-69b8-4965-9dfc-332eb4e2eb7b on hv-cinder-80403 Nov 24 18:36:03.041991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [req-675c41bf-d8cb-467e-bc7c-28fbaa4f5ddb req-2c97b30b-c63d-4fac-ba63-ab752135d384 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090497 Nov 24 18:36:03.042872 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 943/1886] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:36:03.089984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:03.090589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:03.096308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:03.096756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:03.097519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:03.097984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:03.165872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:03.173647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a6d2cd8b-93fb-4f51-b8a8-4571fefa09e9 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 200 len: 1472 microversion: 2.1 time: 0.087406 Nov 24 18:36:03.174899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 944/1887] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:03 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 1472 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:03.989755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:03.991039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:03.999342 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:03.999794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.000681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.001374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.139640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:04.148160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4c044058-98fa-4816-9948-25f6768cf785 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.164732 Nov 24 18:36:04.153054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 944/1888] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:03 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:04.191109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:04.192178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: eae5c20f-69b8-4965-9dfc-332eb4e2eb7b] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:04.198082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.198506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.199277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.199711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.213791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Instance eae5c20f-69b8-4965-9dfc-332eb4e2eb7b could not be found. Nov 24 18:36:04.214368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 404 to user: Instance eae5c20f-69b8-4965-9dfc-332eb4e2eb7b could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:36:04.215206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-50f0dce4-bdde-492e-bcf9-d8d9010a1856 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b" status: 404 len: 111 microversion: 2.1 time: 0.028190 Nov 24 18:36:04.215720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 945/1889] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:04 2021] GET /compute/v2.1/servers/eae5c20f-69b8-4965-9dfc-332eb4e2eb7b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:36:04.224054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:04.224547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:04.230589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.233313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.233313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.233313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.255939 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Going to try to terminate instance {{(pid=116731) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:36:04.500830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-83a7273c-8907-42be-a6a7-9db4ad724666 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 204 len: 0 microversion: 2.1 time: 0.280572 Nov 24 18:36:04.501597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 945/1890] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:36:04 2021] DELETE /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:36:04.511117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:04.511744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:04.518816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.519301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.520084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:04.520524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:04.652932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:04.660175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be11b624-1fe1-4967-af9a-88fe94015e66 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1513 microversion: 2.1 time: 0.152970 Nov 24 18:36:04.660750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 946/1891] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:04 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:05.165077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:05.165791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:05.172445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:05.172911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:05.173701 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:05.174205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:05.304780 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:05.312602 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c355e997-973a-4e53-8761-32a96f59d9fd tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151848 Nov 24 18:36:05.313181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 946/1892] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:05 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:05.566407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-61e712ab-83a6-45e2-96f3-5572e546a0ab req-56e6a9e8-30de-4527-abf4-23f992d8ae11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0", "name": "network-vif-deleted", "tag": "adfbdbfc-1b11-489b-b5e1-9ab0b980464b"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:36:05.568221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:36:05.568221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:36:05.575503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-61e712ab-83a6-45e2-96f3-5572e546a0ab req-56e6a9e8-30de-4527-abf4-23f992d8ae11 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:05.575951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-61e712ab-83a6-45e2-96f3-5572e546a0ab req-56e6a9e8-30de-4527-abf4-23f992d8ae11 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:05.587994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-61e712ab-83a6-45e2-96f3-5572e546a0ab req-56e6a9e8-30de-4527-abf4-23f992d8ae11 service nova] Creating event network-vif-deleted:adfbdbfc-1b11-489b-b5e1-9ab0b980464b for instance 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 on hv-cinder-80403 Nov 24 18:36:05.593298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-61e712ab-83a6-45e2-96f3-5572e546a0ab req-56e6a9e8-30de-4527-abf4-23f992d8ae11 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Nov 24 18:36:05.593930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 947/1893] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:36:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:36:05.676812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:05.677418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:05.683293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:05.684046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:05.684494 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:05.684930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:05.748699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:05.757054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-22701e8c-3e5d-4ab3-b016-d35e7c4acba5 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 200 len: 1471 microversion: 2.1 time: 0.084712 Nov 24 18:36:05.757629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 947/1894] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:05 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:06.330226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:06.330842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:06.336883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:06.337335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:06.338140 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:06.338579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:06.469237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:06.477880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-93bc6e3e-fa00-4aed-9443-0296ee2e189b tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151685 Nov 24 18:36:06.478609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 948/1895] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:06 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:06.774440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:06.775114 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:06.781557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:06.782239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:06.782922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:06.783819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:06.798855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.wsgi [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Instance 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 could not be found. Nov 24 18:36:06.798855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 404 to user: Instance 1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 could not be found. {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:36:06.800288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2fab7cb4-2bbe-42a1-a837-8a8244ecbc53 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0" status: 404 len: 111 microversion: 2.1 time: 0.028417 Nov 24 18:36:06.800788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 948/1896] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:06 2021] GET /compute/v2.1/servers/1ea12d95-3eb3-41d9-aef8-a11fe1ca30d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:36:07.495715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:07.496330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:07.502691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:07.503151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:07.503929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:07.504368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:07.631400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:07.639383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27355d68-f2ea-4f9c-b159-ca4e9809c786 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.147024 Nov 24 18:36:07.639951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 949/1897] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:07 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:08.656731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:08.657297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:08.664407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:08.664848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:08.665609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:08.666068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:08.797336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:08.805182 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-90a2365d-41c5-4b09-8f7a-b33721f49152 tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.152262 Nov 24 18:36:08.805743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 949/1898] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:08 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:09.822346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:09.822346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] [instance: 0d89cec0-16f4-478a-b48a-344063683dff] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:09.828195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:09.839582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:09.839582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:09.839582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:09.961146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e05569bfb84e62846e2e0ff5bc1999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe058a6b6aa84cb1955a9274cae09e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:09.969216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-008ec985-835a-457a-a2a0-5c3ddc373a8d tempest-VolumesSnapshotTestJSON-1627676787 tempest-VolumesSnapshotTestJSON-1627676787-project] 10.222.0.53 "GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff" status: 200 len: 1558 microversion: 2.1 time: 0.151245 Nov 24 18:36:09.969793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 950/1899] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:09 2021] GET /compute/v2.1/servers/0d89cec0-16f4-478a-b48a-344063683dff => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:49.907831 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:49.908396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:49.915682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:49.916139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:49.916976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:49.917362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:49.947429 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Going to try to terminate instance {{(pid=116731) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:36:50.204953 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cb521dde-c118-4975-bf30-109080aef7ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 204 len: 0 microversion: 2.1 time: 0.300520 Nov 24 18:36:50.206199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 950/1900] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:36:49 2021] DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:36:50.214428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:50.215113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:50.220973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:50.221827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:50.222332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:50.222760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:50.352261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:50.359976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e45570e1-27c4-4047-b04f-ee2373c1b7a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1719 microversion: 2.1 time: 0.149298 Nov 24 18:36:50.360545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 951/1901] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:51.379126 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:51.380107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:51.387018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:51.387578 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:51.388469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:51.389345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:51.587699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:51.595295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-605dfd63-bc79-4797-98b0-ad51f2e329a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1719 microversion: 2.1 time: 0.221016 Nov 24 18:36:51.595850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 951/1902] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1719 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:52.037625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-8e391f41-235c-4f2d-9d0f-763dcae568bc req-8051c402-22a6-424c-a51c-8ee918d7ecdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a308b4d-3cdc-4213-82f2-e95a18edd2e0", "name": "network-vif-deleted", "tag": "616ff240-e2a3-4060-827a-0a4cfb95f41a"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:36:52.044138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:36:52.044138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:36:52.056347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-8e391f41-235c-4f2d-9d0f-763dcae568bc req-8051c402-22a6-424c-a51c-8ee918d7ecdf service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:52.065511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-8e391f41-235c-4f2d-9d0f-763dcae568bc req-8051c402-22a6-424c-a51c-8ee918d7ecdf service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:52.071149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-8e391f41-235c-4f2d-9d0f-763dcae568bc req-8051c402-22a6-424c-a51c-8ee918d7ecdf service nova] Creating event network-vif-deleted:616ff240-e2a3-4060-827a-0a4cfb95f41a for instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 on hv-cinder-80403 Nov 24 18:36:52.077128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-8e391f41-235c-4f2d-9d0f-763dcae568bc req-8051c402-22a6-424c-a51c-8ee918d7ecdf service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116648 Nov 24 18:36:52.083438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 952/1903] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:36:52.612917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:52.613525 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:52.619893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:52.620347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:52.621130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:52.621566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:52.684594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:52.692715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c3f33b8f-d4d1-41ec-b6e1-c6fc8f71ed8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084035 Nov 24 18:36:52.693296 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 952/1904] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:53.710987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:53.711681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:53.717702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:53.718182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:53.718953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:53.719384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:53.778117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:53.786997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f41d1400-c48e-4bd5-9a41-87c9432fa474 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080371 Nov 24 18:36:53.787584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 953/1905] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:54.804166 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:54.804760 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:54.811122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:54.811535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:54.812293 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:54.812727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:54.873288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:54.881118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-05ae272c-859e-450b-8732-ed5ccd3e3d11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080621 Nov 24 18:36:54.881678 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 953/1906] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:55.897397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:55.897959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:55.904163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:55.904602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:55.905363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:55.905818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:55.969834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:55.977461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-57b0b559-3238-4d21-8bc9-42ff7c4b0641 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084121 Nov 24 18:36:55.978106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 954/1907] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:56.994668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:56.995289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:57.001597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:57.002588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:57.003380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:57.003820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:57.066130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:57.074125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-70947cf7-16c3-4fa9-ba76-2de96bba5759 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083127 Nov 24 18:36:57.074676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 954/1908] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:58.090205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:58.090808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:58.096992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:58.097438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:58.098244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:58.098683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:58.156477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:58.164881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-55e972fe-ba8b-45e1-b141-9085c04fe398 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078294 Nov 24 18:36:58.165454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 955/1909] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:59.182164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:36:59.182771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:36:59.189000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:59.189490 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:59.190304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:36:59.190740 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:36:59.248285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:36:59.256032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1a968e40-fc5a-4ffc-9f47-72bbaf295e81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077593 Nov 24 18:36:59.256595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 955/1910] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:36:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:00.272645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:00.273260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:00.279530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:00.279982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:00.280758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:00.281195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:00.339476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:00.347199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2bc3237f-3fa1-4cc5-971a-1e7983edb234 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078277 Nov 24 18:37:00.347791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 956/1911] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:01.364538 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:01.368083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:01.371438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:01.371893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:01.372669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:01.373106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:01.434440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:01.442766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e34aebae-fb72-459a-ac07-04ae68edd902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082745 Nov 24 18:37:01.444675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 956/1912] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:02.458723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:02.459330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:02.465743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:02.466229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:02.467005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:02.467447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:02.525397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:02.533010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-196dace0-3d08-4dda-b044-3e312fff7595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078205 Nov 24 18:37:02.533573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 957/1913] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:03.550586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:03.551364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:03.558570 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:03.559015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:03.559790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:03.560216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:03.630075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:03.638125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c2592997-84f4-4b54-ae75-7fd4d5a9c5db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.091199 Nov 24 18:37:03.638697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 957/1914] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:04.655460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:04.656000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:04.663041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:04.663495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:04.664283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:04.664722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:04.723728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:04.731678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-283bfc87-e73f-4f6e-9e2b-f911202d4b21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080002 Nov 24 18:37:04.732247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 958/1915] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:05.748212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:05.748839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:05.755041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:05.755493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:05.756844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:05.757330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:05.814112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:05.822683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3e41eff1-228b-483d-bbb4-c9cc7642e36f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078092 Nov 24 18:37:05.823249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 958/1916] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:06.840466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:06.841094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:06.847480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:06.847929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:06.848695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:06.849129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:06.908917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:06.917673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f8680bf-1c67-4041-b927-b7ae15c5dd0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080973 Nov 24 18:37:06.918268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 959/1917] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:07.934232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:07.934840 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:07.941068 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:07.941517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:07.942316 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:07.942753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:08.003991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:08.012171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fee530ec-c865-4e54-96d4-7e525f46a237 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081614 Nov 24 18:37:08.012732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 959/1918] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:09.028380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:09.029093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:09.035562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:09.036018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:09.036787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:09.037221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:09.098118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:09.105897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-08713946-86cd-41b1-b4e9-98b7868998a8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081169 Nov 24 18:37:09.106462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 960/1919] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:09.582272 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:37:09.582736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:37:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:37:10.122530 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:10.123143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:10.129125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:10.129576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:10.130372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:10.130810 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:10.189220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:10.197439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ae36003-cf88-4d73-9690-b2cbc7a4e977 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078549 Nov 24 18:37:10.198031 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 960/1920] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:10.427971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:37:10.428437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:37:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:37:11.214631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:11.215248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:11.221202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:11.221654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:11.222463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:11.222900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:11.281056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:11.289406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1097cacb-edc4-4eb1-93c1-4b12b8236b98 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078481 Nov 24 18:37:11.290003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 961/1921] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:12.306700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:12.307297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:12.313536 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:12.314021 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:12.314795 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:12.315249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:12.374347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:12.382564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3453a754-939b-4ee7-9c86-99f464052922 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079926 Nov 24 18:37:12.383115 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 961/1922] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:13.400340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:13.400874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:13.407120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:13.407569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:13.408345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:13.408776 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:13.468560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:13.477036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f043636-f434-4461-a3e9-d7db2ec3c0e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080890 Nov 24 18:37:13.477598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 962/1923] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:14.494080 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:14.494682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:14.500835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:14.501277 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:14.502058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:14.502489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:14.561034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:14.568890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-ce0fc2c0-ead8-4dde-a9a0-f842393970e4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079117 Nov 24 18:37:14.569450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 962/1924] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:15.584691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:15.586380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:15.592692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:15.593144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:15.593949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:15.594382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:15.654659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:15.662748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-28fa9c0f-9bbb-4c7d-9896-6373ee7af360 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081756 Nov 24 18:37:15.664024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 963/1925] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:16.679584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:16.680213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:16.686458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:16.686900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:16.687660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:16.688088 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:16.750042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:16.758552 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-61bd9b28-c21b-4de7-b762-257277c0b555 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083151 Nov 24 18:37:16.759125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 963/1926] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:17.775421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:17.776021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:17.782666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:17.783241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:17.784150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:17.784946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:17.843165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:17.851310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a85e714c-a9a9-465c-9b7e-c1fc6d2d9454 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079710 Nov 24 18:37:17.851871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 964/1927] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:18.868569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:18.869195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:18.875412 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:18.875857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:18.876622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:18.877056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:18.934826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:18.942356 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-984cc618-db99-4bc8-afeb-b283213decf9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078161 Nov 24 18:37:18.942910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 964/1928] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:19.959557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:19.960781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:19.966945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:19.967392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:19.968166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:19.968601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:20.027462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:20.035363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a7b39a4c-9346-48b5-becc-8753144b314a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079426 Nov 24 18:37:20.035926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 965/1929] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:21.052540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:21.053178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:21.060428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:21.060877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:21.061650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:21.062109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:21.123847 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:21.131561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-81d104f2-4231-4d8b-8a3c-032853f1043c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082729 Nov 24 18:37:21.132317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 965/1930] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:22.148267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:22.149555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:22.155647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:22.156131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:22.156905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:22.157341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:22.219128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:22.227456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-80fd6041-fdf9-4632-9a2a-ff19e7868aa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082235 Nov 24 18:37:22.228032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 966/1931] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:23.244647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:23.245259 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:23.251583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:23.252030 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:23.252812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:23.253243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:23.312287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:23.319879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7959823-48f9-4366-9421-0ad7b2de7b70 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079514 Nov 24 18:37:23.320439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 966/1932] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:24.337691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:24.338331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:24.344456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:24.344895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:24.345656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:24.346115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:24.404103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:24.412002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e2370e21-e4c7-4d5c-92e4-2f0cc4747e80 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078876 Nov 24 18:37:24.412568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 967/1933] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:25.428333 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:25.428936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:25.435238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:25.435683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:25.436441 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:25.436867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:25.495572 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:25.503329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4dcaa91f-ed23-4a00-85ab-a62a30328296 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078768 Nov 24 18:37:25.503896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 967/1934] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:26.518927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:26.519534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:26.526463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:26.526913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:26.527687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:26.528122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:26.588234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:26.595971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-07f686c5-1fb2-44c2-b26c-b497e43ba7de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080678 Nov 24 18:37:26.596534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 968/1935] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:27.242135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:37:27.242741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:37:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:37:27.613890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:27.614493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:27.621380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:27.621903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:27.622676 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:27.623127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:27.681862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:27.689542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-06eb22e2-18da-4d0b-a204-d5edb0b4f57a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079376 Nov 24 18:37:27.690130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 968/1936] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:28.707276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:28.707908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:28.715207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:28.715738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:28.716590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:28.717100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:28.778067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:28.786333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe790d77-07ba-4617-aae4-4abd6940ddde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082738 Nov 24 18:37:28.786907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 969/1937] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:29.803858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:29.804467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:29.811193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:29.811580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:29.812349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:29.812806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:29.870812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:29.878325 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e235e5c7-e2a8-4c96-ba4a-b8d2fcc080af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078110 Nov 24 18:37:29.878884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 969/1938] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:30.895415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:30.896034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:30.902491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:30.902941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:30.903720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:30.904186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:30.962218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:30.969996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c2e9201b-d78a-4e58-a511-ccc89fe9190d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078178 Nov 24 18:37:30.970567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 970/1939] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:31.987047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:31.987647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:31.994468 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:31.994913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:31.995710 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:31.996138 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:32.055369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:32.062907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6a6bee67-724b-4d3e-9410-677ce20c15db tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079530 Nov 24 18:37:32.063658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 970/1940] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:33.079686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:33.080301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:33.086648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:33.087095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:33.087875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:33.088323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:33.145663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:33.153419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-725896d4-bccc-44cd-8e64-a3abdec8d155 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077480 Nov 24 18:37:33.154010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 971/1941] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:34.171746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:34.172348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:34.178652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:34.179098 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:34.180041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:34.180526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:34.241752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:34.249444 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b049d7cc-7483-46f5-82b4-fa46f36c1bf4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081368 Nov 24 18:37:34.250044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 971/1942] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:35.266011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:35.266630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:35.272779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:35.273231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:35.274145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:35.274582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:35.336210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:35.343893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-33099a80-1882-4e26-9d55-772180734076 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081511 Nov 24 18:37:35.344463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 972/1943] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:36.361965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:36.362533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:36.369925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:36.370379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:36.371150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:36.371591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:36.429890 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:36.437407 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5fad4ca5-c441-40b2-8172-9ccccfc1e5dd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079246 Nov 24 18:37:36.438007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 972/1944] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:37.454286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:37.454971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:37.461919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:37.462386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:37.463654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:37.463654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:37.530761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:37.538714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23dcc87f-ec0c-48fe-b50e-cdc91a90ac02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.088104 Nov 24 18:37:37.540774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 973/1945] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:37:38.557594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:38.558224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:38.564495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:38.564932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:38.565695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:38.566150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:38.624700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:38.632411 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-491311ae-aa63-4f8d-ac2c-28afa7ca8129 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079402 Nov 24 18:37:38.633483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 973/1946] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:39.650404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:39.651023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:39.657207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:39.657659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:39.658466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:39.659156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:39.718109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:39.725712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4b742b4a-d0dc-4cd5-9672-7577f11a8e44 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079898 Nov 24 18:37:39.726297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 974/1947] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:40.743705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:40.744314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:40.750460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:40.750914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:40.751728 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:40.752205 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:40.810682 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:40.818252 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0e71ccbb-503d-4a0a-aa53-7aa6d5da9fa2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078881 Nov 24 18:37:40.818820 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 974/1948] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:41.835053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:41.835607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:41.842032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:41.842480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:41.843247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:41.843681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:41.903339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:41.911512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b58a3997-9343-4676-86a4-8bdb6f57ffd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080221 Nov 24 18:37:41.912077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 975/1949] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:42.928533 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:42.929118 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:42.935903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:42.936352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:42.937108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:42.937543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:42.994649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:43.002198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-35297d0a-6e34-40ad-b2fe-83f10f7a6a93 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077243 Nov 24 18:37:43.002757 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 975/1950] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:44.017887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:44.018519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:44.024915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:44.025351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:44.026144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:44.026575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:44.084462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:44.092241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-53dc2309-ba01-4c98-9e74-b5b0eecdedb4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077958 Nov 24 18:37:44.092801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 976/1951] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:45.108769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:45.109414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:45.115638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:45.116089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:45.117269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:45.117465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:45.175243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:45.183143 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4258495e-48ee-4526-968d-a81196aea5e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078048 Nov 24 18:37:45.183709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 976/1952] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:46.199795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:46.200397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:46.206621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:46.207077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:46.207856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:46.208311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:46.267386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:46.275552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78f1a62d-e61f-479a-9f00-5412f8a45513 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079426 Nov 24 18:37:46.276119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 977/1953] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:37:47.292683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:47.293283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:47.299419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:47.299860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:47.300616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:47.301044 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:47.361223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:47.369751 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fb58f04a-0c04-4bc7-9a42-e1abfed9342e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081210 Nov 24 18:37:47.370326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 977/1954] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:48.387392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:48.387998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:48.394247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:48.394729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:48.395504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:48.395998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:48.460408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:48.468278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c9f28182-a831-4482-852f-fdf0542bdfb2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084582 Nov 24 18:37:48.468819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 978/1955] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:49.484215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:49.484815 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:49.491122 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:49.491571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:49.492349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:49.492786 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:49.554204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:49.562269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a0940a81-4f5c-4c15-8591-26dfe84185fb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081748 Nov 24 18:37:49.562903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 978/1956] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:50.578660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:50.579263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:50.586158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:50.586531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:50.587296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:50.587720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:50.644746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:50.652893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-66a59e8b-a3db-4a35-aba7-d00922bc6903 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077849 Nov 24 18:37:50.653521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 979/1957] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:51.670075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:51.670709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:51.676956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:51.677396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:51.678178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:51.678606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:51.736526 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:51.744904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-74927d49-c2a7-47b4-ba3b-47a099b3e974 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078468 Nov 24 18:37:51.745857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 979/1958] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:52.761210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:52.761868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:52.768212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:52.768658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:52.769438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:52.769900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:52.828089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:52.836470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dadb70bd-7e93-4d28-8fc1-64ac9551924e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078743 Nov 24 18:37:52.836950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 980/1959] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:37:53.852867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:53.853857 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:53.860398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:53.860853 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:53.861784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:53.862251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:53.933078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:53.941234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4cd6b4c8-e2ef-4b07-b220-d3876d638273 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.092590 Nov 24 18:37:53.941812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 980/1960] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:54.959575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:54.961181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:54.967062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:54.967516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:54.968297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:54.968732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:55.027414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:55.035345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-de381ee1-eb75-4cd8-903c-336db3a2fd37 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079572 Nov 24 18:37:55.035920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 981/1961] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:56.051991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:56.052606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:56.059171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:56.059642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:56.060395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:56.060833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:56.119994 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:56.127705 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2427e53e-2bc2-4570-960f-e98e9acc0f72 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079362 Nov 24 18:37:56.128262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 981/1962] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:57.144751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:57.145371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:57.151859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:57.152310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:57.153078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:57.153511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:57.212612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:57.220261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-775aa97e-d588-4d98-acc2-17280204b8fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079216 Nov 24 18:37:57.222239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 982/1963] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:58.237830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:58.238434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:58.245208 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:58.245650 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:58.246433 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:58.246862 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:58.308589 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:58.316324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-383eeb00-a4af-4b01-b6d0-c3fc22b3012f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082141 Nov 24 18:37:58.316885 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 982/1964] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:59.334159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:59.334793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:37:59.340941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:59.341382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:59.342170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:37:59.342630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:37:59.400119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:59.407716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-799b7378-3c29-4bf9-8fa1-4e6713494721 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077186 Nov 24 18:37:59.408297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 983/1965] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:00.424227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:00.424845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:00.431771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:00.432219 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:00.432997 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:00.433439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:00.490884 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:00.499868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1ff2aacf-25e6-450d-a709-8a19b0bd45aa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079406 Nov 24 18:38:00.500445 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 983/1966] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:01.517312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:01.517954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:01.524842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:01.525294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:01.526116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:01.526556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:01.588579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:01.603712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cdb80bf5-9e5c-4c0d-8180-1ce91e2c34cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.090057 Nov 24 18:38:01.604290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 984/1967] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:02.620961 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:02.621581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:02.627851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:02.628309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:02.629093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:02.629542 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:02.686992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:02.694667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ecc5cf1-d8c3-4275-a83f-01ae0e299483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077893 Nov 24 18:38:02.695418 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 984/1968] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:03.712100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:03.712704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:03.718914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:03.719360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:03.720131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:03.720563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:03.777961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:03.786012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-83eaa66e-c6c4-4488-9983-6d27d1ea3c01 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078289 Nov 24 18:38:03.786582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 985/1969] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:04.803419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:04.804085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:04.811100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:04.811545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:04.812307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:04.812735 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:04.871188 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:04.878922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5187bfef-c459-4360-bbda-c3d72bf38ca4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079238 Nov 24 18:38:04.879485 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 985/1970] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:05.895793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:05.896349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:05.903269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:05.903717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:05.904497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:05.904936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:05.963724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:05.971523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-55634949-c163-4334-9add-f0e62d1d5fd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079515 Nov 24 18:38:05.974327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 986/1971] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:06.988893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:06.989505 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:06.996616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:06.997377 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:06.998042 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:06.998481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:07.057037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:07.064670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d254dafc-0901-4fb1-9391-2ea3ed4a6397 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079638 Nov 24 18:38:07.065238 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 986/1972] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:38:08.080691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:08.081303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:08.088220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:08.088661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:08.089426 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:08.089883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:08.146694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:08.154906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cd946b6f-acab-4271-969d-dc63e7a4d3ac tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077863 Nov 24 18:38:08.155467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 987/1973] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:09.172075 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:09.172688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:09.179582 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:09.180239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:09.181019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:09.181457 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:09.237839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:09.246073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9364d36e-aca0-4b1a-84aa-c526a00225e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077605 Nov 24 18:38:09.246647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 987/1974] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:10.262937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:10.263542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:10.269495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:10.269977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:10.270742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:10.271200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:10.329187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:10.337475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48d91667-69a4-4e92-8842-b414d47e3342 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078377 Nov 24 18:38:10.338061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 988/1975] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:11.353892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:11.354492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:11.360509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:11.360957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:11.361719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:11.362181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:11.423736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:11.431899 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2ce422a4-f929-4926-a066-28602a0edbaa tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081659 Nov 24 18:38:11.433593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 988/1976] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:12.448751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:12.449361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:12.455654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:12.456103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:12.456876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:12.457314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:12.515025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:12.523433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7064c80c-de46-4d48-ba4d-11bde7814822 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078311 Nov 24 18:38:12.524001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 989/1977] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:13.540637 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:13.541255 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:13.547497 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:13.547935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:13.548697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:13.549120 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:13.608976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:13.617724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2b301748-1280-4cb9-a964-41c7af452344 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081362 Nov 24 18:38:13.618313 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 989/1978] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:14.635162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:14.635774 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:14.642252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:14.643006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:14.644382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:14.645103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:14.710319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:14.717952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-de656efd-82bc-4c0b-ba4c-57641aad9c5c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.087441 Nov 24 18:38:14.718508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 990/1979] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:15.735235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:15.735859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:15.742201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:15.742688 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:15.743459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:15.743901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:15.803322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:15.811878 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-522e0e0b-ead1-4afc-a50d-ed0dc39cab26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080270 Nov 24 18:38:15.812382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 990/1980] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:16.829058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:16.829611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:16.835771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:16.836212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:16.836970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:16.837396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:16.896285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:16.904955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a285c62-4133-4c49-9c2f-83dff9b2a8ab tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079569 Nov 24 18:38:16.905513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 991/1981] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:17.922958 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:17.923571 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:17.929944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:17.930395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:17.931165 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:17.931598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:17.989990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:17.997549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-746379c4-ce35-4fea-996a-e7d2b8b9cd28 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078221 Nov 24 18:38:17.998139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 991/1982] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:19.014165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:19.014764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:19.020955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:19.021408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:19.022720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:19.023161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:19.080499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:19.089003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-53188284-63d8-4c9b-915b-9fc63d0787b3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078519 Nov 24 18:38:19.089572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 992/1983] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:20.106109 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:20.106715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:20.112864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:20.113307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:20.114125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:20.114555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:20.173649 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:20.181923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dc50cf5c-d160-4a3b-ac4e-17cb98e3b42c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079529 Nov 24 18:38:20.182481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 992/1984] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:38:21.198919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:21.199522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:21.205661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:21.206134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:21.206892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:21.207319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:21.264946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:21.273003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cda160ff-13df-434d-82bd-84a4f3e50710 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077690 Nov 24 18:38:21.273625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 993/1985] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:22.290067 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:22.290680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:22.296903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:22.297350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:22.298162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:22.298597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:22.356074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:22.363923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bac37813-4c86-47a8-9cc0-2807b4f7b0fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078047 Nov 24 18:38:22.364511 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 993/1986] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:23.382307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:23.382910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:23.389050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:23.389496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:23.390393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:23.390842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:23.448406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:23.456002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b71d0e2a-33ec-4345-b261-609624701b6d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078186 Nov 24 18:38:23.456559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 994/1987] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:24.472438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:24.473049 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:24.480207 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:24.480658 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:24.481437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:24.481903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:24.544057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:24.551690 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bf7c2f04-8a4f-4e35-9a7c-33fb1f481cd7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083131 Nov 24 18:38:24.552483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 994/1988] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:25.569886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:25.570487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:25.576676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:25.577115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:25.577896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:25.578325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:25.635865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:25.643493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-81845833-f6e0-466b-a5b4-091803ebfc26 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077888 Nov 24 18:38:25.644061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 995/1989] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:26.661012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:26.661638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:26.668588 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:26.669028 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:26.669811 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:26.670240 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:26.728112 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:26.735743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-557f7891-74dc-49a8-9e06-a5a06d343a6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078625 Nov 24 18:38:26.736308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 995/1990] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:27.752401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:27.752990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:27.759682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:27.760125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:27.760887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:27.761315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:27.822235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:27.829996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c41ce320-d0a8-4ae1-8404-b24d53505514 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081236 Nov 24 18:38:27.830567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 996/1991] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:28.846185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:28.846738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:28.853245 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:28.853697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:28.854492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:28.854927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:28.917073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:28.925085 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-18cd3a9d-41f2-4a99-92bc-b064e29b7744 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082589 Nov 24 18:38:28.925665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 996/1992] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:29.942955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:29.943575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:29.949902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:29.950353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:29.951133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:29.951572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:30.010032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:30.017874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-94eaab15-d489-4bb8-9e49-08660e305814 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078679 Nov 24 18:38:30.018444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 997/1993] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:31.035430 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:31.036018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:31.042403 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:31.042844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:31.043605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:31.044036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:31.103471 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:31.110992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5572b6fd-ec82-4984-9282-8f3d6503cedb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079506 Nov 24 18:38:31.111547 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 997/1994] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:32.127377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:32.127967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:32.134770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:32.135220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:32.135998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:32.136447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:32.195517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:32.203723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-305d7aed-be99-4cc5-b88b-fbdab324531a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080052 Nov 24 18:38:32.204293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 998/1995] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:33.221181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:33.221805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:33.228726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:33.229170 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:33.229959 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:33.230387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:33.288105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:33.296569 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-393b82d8-ef55-4876-8647-50490344dbd9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078980 Nov 24 18:38:33.297054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 998/1996] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:34.312089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:34.312683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:34.318949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:34.319409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:34.320179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:34.321267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:34.378696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:34.387350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f2534d9e-7d51-486d-8dc6-61d2cb856866 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078963 Nov 24 18:38:34.389952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 999/1997] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:35.404264 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:35.404864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:35.411322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:35.411764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:35.412521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:35.412946 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:35.470185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:35.478154 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0f5de3f2-9fb5-430c-a6c5-4aef7131e483 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077502 Nov 24 18:38:35.478709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 999/1998] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:36.495416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:36.496025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:36.502209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:36.502655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:36.503431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:36.503867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:36.562559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:36.570409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c89b9a01-26f8-4329-9111-016dc25118b8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079322 Nov 24 18:38:36.570977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1000/1999] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:37.588836 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:37.589515 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:37.596456 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:37.597039 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:37.597935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:37.598451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:37.662096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:37.670380 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-17f1a55a-dcca-474a-a16e-9d942038437a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.086553 Nov 24 18:38:37.670943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1000/2000] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:38.687234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:38.687805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:38.694045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:38.694495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:38.695326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:38.695769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:38.753204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:38.761606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eed9be60-7a65-49fb-a767-7a0c769d6c74 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078217 Nov 24 18:38:38.762211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1001/2001] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:39.778716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:39.779324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:39.785778 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:39.786232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:39.787006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:39.787470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:39.846330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:39.854700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d3155029-6405-49f4-9e01-3ab6c2e04dcf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080168 Nov 24 18:38:39.855261 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1001/2002] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:40.871419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:40.871972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:40.877877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:40.878332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:40.879103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:40.879540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:40.939652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:40.948125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7e6ab37b-fab0-4469-b0c8-e33691504ede tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081084 Nov 24 18:38:40.948704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1002/2003] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:41.965425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:41.966077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:41.972046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:41.972492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:41.973257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:41.973693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:42.032938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:42.040695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-43af09a9-2e2b-4602-90ba-d349a8c55193 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079878 Nov 24 18:38:42.041254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1002/2004] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:43.057943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:43.058570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:43.064751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:43.065203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:43.066009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:43.066447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:43.124116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:43.131697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b3b14c81-b54b-4ce4-91e4-c6b178588c9d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077934 Nov 24 18:38:43.132319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1003/2005] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:44.148917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:44.149521 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:44.155948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:44.156389 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:44.157150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:44.157864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:44.218091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:44.225551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3a76d732-8b2b-41dc-bc92-486655f4fe78 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080244 Nov 24 18:38:44.226135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1003/2006] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:45.242110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:45.242696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:45.249149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:45.249589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:45.250385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:45.250820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:45.308517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:45.316033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-297ec49f-2aa9-4cca-bd68-ad89dde0e42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077581 Nov 24 18:38:45.316586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1004/2007] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:46.332176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:46.332773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:46.340179 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:46.340628 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:46.341395 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:46.341852 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:46.400785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:46.408719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b31690c8-b3e0-48b9-b9e6-c6189aaa295c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080243 Nov 24 18:38:46.409280 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1004/2008] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:47.425395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:47.426036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:47.433044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:47.433499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:47.434322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:47.434762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:47.491551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:47.500258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9f79a554-f1a7-4cf1-8516-3cb4e04169a9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078540 Nov 24 18:38:47.500822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1005/2009] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:48.516861 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:48.517473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:48.523774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:48.524227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:48.525684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:48.526149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:48.584304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:48.592755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7b275dda-da06-4faf-a812-5527ef520b84 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079579 Nov 24 18:38:48.593314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1005/2010] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:49.609303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:49.609956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:49.616150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:49.616637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:49.617409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:49.617874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:49.675650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:49.684038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5b76e3ed-9114-4c48-94a1-da9f3e72592a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078365 Nov 24 18:38:49.684612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1006/2011] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:50.701036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:50.701591 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:50.707838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:50.708288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:50.709094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:50.709529 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:50.770599 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:50.779354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-70303527-6ddf-430b-ab9f-1d9664b0b5e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082352 Nov 24 18:38:50.779925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1006/2012] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:51.796648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:51.797562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:51.808812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:51.809569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:51.810745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:51.811473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:51.869063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:51.876758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d171beea-a67a-4181-a220-c05eb076a137 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083920 Nov 24 18:38:51.877337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1007/2013] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:52.411311 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:52.411840 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:52.418681 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.419133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.419911 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.420351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.434235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.wsgi [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. Nov 24 18:38:52.434954 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. {{(pid=116731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:38:52.435788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-c109a4b0-74c6-4b25-8c42-bd70ded6a08e tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 404 len: 111 microversion: 2.1 time: 0.028344 Nov 24 18:38:52.436782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1007/2014] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:38:52 2021] DELETE /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:38:52.444145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:52.444789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 73f647ca-2f72-4260-93ad-0b9e49ec7d16] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:52.450734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.451262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.452055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.452493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.466063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. Nov 24 18:38:52.466655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 73f647ca-2f72-4260-93ad-0b9e49ec7d16 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:38:52.467476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-efd158b4-337d-4e06-8587-40505a05a386 tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16" status: 404 len: 111 microversion: 2.1 time: 0.026982 Nov 24 18:38:52.468303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1008/2015] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:52 2021] GET /compute/v2.1/servers/73f647ca-2f72-4260-93ad-0b9e49ec7d16 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:38:52.893565 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:52.894111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:52.900484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.900932 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.901698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:52.902157 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:52.961406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:52.969258 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d95d086b-b550-491e-9263-4539a6bd4052 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079410 Nov 24 18:38:52.969842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1008/2016] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:53.986556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:53.987141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:53.994075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:53.994515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:53.995277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:53.995706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:54.057684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:54.065241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7e468d25-6006-4a85-86d9-1ef0bc001e21 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082300 Nov 24 18:38:54.065866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1009/2017] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:38:55.081667 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:55.082309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:55.089326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:55.093792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:55.093792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:55.093792 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:55.151892 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:55.163191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-30ec19da-c0d5-445c-a883-7e781ce9af7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.085174 Nov 24 18:38:55.163747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1009/2018] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:56.183534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:56.184149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:56.190577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:56.191030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:56.191809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:56.192247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:56.250205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:56.257754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aea3c2c0-9413-46ac-87b6-72ab1443e3ec tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078546 Nov 24 18:38:56.258356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1010/2019] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:57.274426 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:57.275121 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:57.281373 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:57.281851 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:57.282893 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:57.283324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:57.342821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:57.350464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-17e3ec31-787f-4db6-adb7-5481f5498bde tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079655 Nov 24 18:38:57.351008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1010/2020] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:58.367433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:58.368289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:58.374829 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:58.375289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:58.376065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:58.376502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:58.434376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:58.442083 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d569ee81-326e-42ee-927c-43f719457735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078301 Nov 24 18:38:58.442644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1011/2021] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:38:59.459731 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:38:59.460375 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:38:59.467250 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:59.467698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:59.468473 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:38:59.468907 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:38:59.526935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:38:59.534764 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1602fce6-7869-4200-aa1b-2ac5b58508c6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078859 Nov 24 18:38:59.535323 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1011/2022] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:38:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:00.551749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:00.552355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:00.558826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:00.559306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:00.560093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:00.560530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:00.618597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:00.626363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c29e66c6-9a04-433d-be29-4ffe7203be88 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078318 Nov 24 18:39:00.626938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1012/2023] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:01.643017 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:01.643627 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:01.650063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:01.650509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:01.651290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:01.651743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:01.708952 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:01.716648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1f7bfd9d-f911-4faf-b6fc-071f02c68ece tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077244 Nov 24 18:39:01.717200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1012/2024] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:02.734058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:02.734613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:02.740879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:02.741326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:02.742121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:02.742554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:02.800304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:02.808487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-615b2f17-40fa-4211-9cbb-c25ae8ed258b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078171 Nov 24 18:39:02.809046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1013/2025] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:03.825290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:03.825846 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:03.832090 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:03.832543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:03.833353 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:03.833923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:03.897984 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:03.906018 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9ad3c033-aaae-4ad8-a377-699b61bc554f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.085370 Nov 24 18:39:03.906587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1013/2026] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:04.923286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:04.923902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:04.930311 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:04.930748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:04.932416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:04.932914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:04.990126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:04.998374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c65e6b6-1124-4769-b334-eaebab383ddb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078878 Nov 24 18:39:04.998933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1014/2027] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:06.015466 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:06.016069 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:06.022520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:06.022965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:06.023732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:06.024163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:06.082387 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:06.091158 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9ae3b53c-1852-4932-a13a-6dc36d6fdf83 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079301 Nov 24 18:39:06.091746 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1014/2028] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:07.108506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:07.109139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:07.115321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:07.115770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:07.116602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:07.117040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:07.181060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:07.188987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3d10b604-9f11-41e6-96b0-52ad7c3d5a02 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084267 Nov 24 18:39:07.189561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1015/2029] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:39:08.206396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:08.207013 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:08.214180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:08.214632 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:08.215409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:08.215845 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:08.274125 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:08.284256 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-874d13c5-be20-44b1-b70a-d221ae2ad3ae tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081451 Nov 24 18:39:08.284819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1015/2030] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:39:09.303447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:09.304076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:09.311028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:09.311480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:09.312256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:09.312701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:09.370825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:09.378515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d28d6656-fdaf-4a03-af22-7c84b6229c1b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078823 Nov 24 18:39:09.379091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1016/2031] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:10.395888 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:10.396496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:10.402598 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:10.403047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:10.403822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:10.404262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:10.462512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:10.470302 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-aad8f533-8735-4a59-8c1d-57006b4d0a6e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078104 Nov 24 18:39:10.470866 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1016/2032] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:10.547486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:39:10.548036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:39:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:39:11.489831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:11.490432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:11.496441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:11.496882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:11.497639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:11.498091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:11.557674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:11.565668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ce98d8ac-1840-4fbd-b89b-885a4bb2e115 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079625 Nov 24 18:39:11.566270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1017/2033] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:12.582317 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:12.582960 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:12.589848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:12.590298 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:12.591063 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:12.591498 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:12.648344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:12.656908 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-42fe1588-ddc8-4382-9301-b6f6e5eea09c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078165 Nov 24 18:39:12.657720 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1017/2034] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:13.673687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:13.674304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:13.680553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:13.681754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:13.682369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:13.682795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:13.739528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:13.748232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-66fecfea-142d-4165-a829-0558cced4df9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078225 Nov 24 18:39:13.748798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1018/2035] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:14.765077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:14.765625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:14.771858 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:14.772308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:14.773078 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:14.773512 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:14.832902 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:14.841239 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-05c07f2c-f042-4462-a8dd-5afc20835bb0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079880 Nov 24 18:39:14.841822 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1018/2036] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:15.081846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:39:15.082396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:39:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:39:15.857973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:15.858503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:15.864693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:15.868678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:15.868678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:15.868678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:15.926645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:15.935622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b220d4a4-7ed5-4f2b-8753-ad99d1c229af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081442 Nov 24 18:39:15.936190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1019/2037] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:16.952344 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:16.953008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:16.959110 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:16.959555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:16.960314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:16.960741 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:17.022577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:17.030450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-af5c5680-adfc-4952-b9c5-76bbb634fbe0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081781 Nov 24 18:39:17.031007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1019/2038] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:17.104464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:39:17.104643 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:39:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:39:18.047908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:18.048525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:18.054804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:18.055256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:18.056247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:18.056690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:18.114277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:18.122092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2e3db1c2-4e11-43d5-bc13-f32b9667bf8a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077866 Nov 24 18:39:18.122657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1020/2039] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:19.139223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:19.139813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:19.146006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:19.146446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:19.147203 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:19.147626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:19.206330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:19.214774 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9b94f4e5-343d-4fbe-8cc4-626aa4d34d08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079155 Nov 24 18:39:19.215329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1020/2040] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:20.231481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:20.232090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:20.238333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:20.238779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:20.239555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:20.239992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:20.300298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:20.308650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6288879e-755c-430e-87b8-ad4e3f1cf47d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080829 Nov 24 18:39:20.309215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1021/2041] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:21.327335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:21.327922 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:21.334213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:21.334654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:21.335408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:21.335834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:21.393332 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:21.400943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8c6acb2e-8f4d-4e6f-b47e-3f2770585d1f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077232 Nov 24 18:39:21.401495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1021/2042] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:22.418260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:22.418903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:22.425334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:22.425802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:22.426606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:22.427035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:22.485717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:22.493388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7c1b641f-718f-454a-ac1b-21797443702c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079372 Nov 24 18:39:22.493973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1022/2043] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:23.510700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:23.511330 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:23.517539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:23.518019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:23.518791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:23.519226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:23.577736 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:23.585481 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b8a8dc3b-e69b-4d1b-8c2d-493e081703b4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079227 Nov 24 18:39:23.586077 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1022/2044] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:39:24.602883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:24.603502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:24.609731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:24.610206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:24.610977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:24.611412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:24.669593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:24.677420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6a0ce4ac-e117-47fb-86cf-aaa07704a26e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078890 Nov 24 18:39:24.678024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1023/2045] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:25.694756 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:25.695394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:25.702766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:25.703213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:25.703983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:25.704413 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:25.762928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:25.770567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-07056da3-0ddf-4b2d-8235-5ea999a39cce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079431 Nov 24 18:39:25.771124 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1023/2046] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:26.787619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:26.788159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:26.794858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:26.795303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:26.796100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:26.796535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:26.855537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:26.863346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dee1562c-4063-49f2-b9fa-218ebdd8064b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079503 Nov 24 18:39:26.863918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1024/2047] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:27.880322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:27.880865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:27.888520 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:27.889156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:27.890178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:27.890719 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:27.949821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:27.957698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7acd457-84b6-49db-aa84-817532f058ea tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081190 Nov 24 18:39:27.958287 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1024/2048] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:28.974359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:28.974972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:28.981748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:28.982228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:28.983001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:28.983439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:29.042515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:29.050053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10292404-0428-4649-979d-b2cc5e0e0a81 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079303 Nov 24 18:39:29.050615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1025/2049] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:30.066019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:30.066617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:30.073012 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:30.073464 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:30.074274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:30.074713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:30.135234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:30.142835 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8c29e17b-9afb-4e1d-9d8d-14962a23f84c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080449 Nov 24 18:39:30.143393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1025/2050] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:31.160067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:31.160708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:31.166934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:31.167380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:31.168150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:31.168581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:31.225656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:31.233745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d7d5be1d-b27f-4912-8d97-887f8dab6280 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077542 Nov 24 18:39:31.234336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1026/2051] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:32.250416 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:32.251034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:32.257167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:32.257609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:32.258402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:32.258880 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:32.535583 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:32.544233 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4d3818a8-25ea-401a-a428-cc0cc9c6fb3e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.297423 Nov 24 18:39:32.544794 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1026/2052] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:33.560708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:33.561276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:33.567817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:33.573631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:33.573631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:33.573631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:33.632094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:33.640337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe5f746d-bc74-4033-888a-e77f5e257482 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083608 Nov 24 18:39:33.640902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1027/2053] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:34.658037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:34.658636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:34.665094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:34.665544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:34.666341 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:34.666776 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:34.724842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:34.733348 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-823ea27d-8978-4094-97b1-aef30de951cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079184 Nov 24 18:39:34.733945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1027/2054] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:35.750094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:35.750689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:35.757160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:35.757741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:35.758546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:35.758984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:35.817601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:35.826540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f4f54289-3eda-42e7-8675-105b46fed1fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080131 Nov 24 18:39:35.827107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1028/2055] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:36.843768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:36.844336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:36.850609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:36.855680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:36.855680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:36.855680 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:36.913297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:36.922036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-acdae382-9786-49bc-a33d-69d275da15a4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081886 Nov 24 18:39:36.922668 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1028/2056] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:37.948005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:37.948644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:37.954824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:37.955265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:37.956026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:37.956453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:38.020355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:38.028515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2fce0b24-d685-4abe-b136-b5a32e49f3fe tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.092579 Nov 24 18:39:38.029075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1029/2057] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:39.045990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:39.046661 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:39.053048 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:39.053546 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:39.054351 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:39.054790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:39.113543 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:39.121828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-93894d6e-8746-433e-bb68-f798fbf9ea11 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080779 Nov 24 18:39:39.122406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1029/2058] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:40.139329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:40.139938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:40.145703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:40.146178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:40.146933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:40.147363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:40.204718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:40.212330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71a86321-a7ff-4cb9-92fe-6da628653a6c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.076741 Nov 24 18:39:40.213666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1030/2059] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:41.229371 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:41.230008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:41.236058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:41.236513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:41.237274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:41.237707 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:41.297724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:41.305401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-705f2bd5-bde5-415e-90b6-3b9cbe3fe84e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080353 Nov 24 18:39:41.305990 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1030/2060] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:42.322923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:42.323588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:42.329873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:42.330323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:42.331090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:42.331529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:42.389455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:42.397131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bd79cd9e-7d79-4d64-9a62-e0ff916a2992 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078388 Nov 24 18:39:42.397701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1031/2061] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:43.414209 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:43.414839 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:43.421724 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:43.422192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:43.422951 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:43.423379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:43.482460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:43.490130 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-96780e88-71b6-47d2-9f2f-a8daf6eb60e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079594 Nov 24 18:39:43.490699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1031/2062] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:44.508077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:44.508724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:44.515676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:44.516297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:44.517072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:44.517508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:44.576460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:44.584437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-45583117-fc71-4714-b6f1-6b917a635fb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081025 Nov 24 18:39:44.585013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1032/2063] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:45.601191 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:45.601841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:45.608630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:45.609082 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:45.609886 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:45.610324 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:45.668291 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:45.675923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6a0a34f5-f6fc-4170-9281-864e7bfbce9b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078338 Nov 24 18:39:45.676484 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1032/2064] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:46.693009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:46.693619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:46.699850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:46.700303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:46.701074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:46.701513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:46.761999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:46.769677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1b4341d-ff9d-49f7-b126-876064b9ca08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080361 Nov 24 18:39:46.770282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1033/2065] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:47.787162 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:47.787768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:47.794064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:47.794502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:47.795260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:47.795683 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:47.853532 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:47.861059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2bb9b678-8ee4-46a3-bc36-b7d27fa8b106 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077519 Nov 24 18:39:47.861617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1033/2066] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:48.877941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:48.878518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:48.885143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:48.885599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:48.886389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:48.886826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:48.944662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:48.952750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-41c4f197-62dc-4c42-b796-fa0419d2afbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078562 Nov 24 18:39:48.953313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1034/2067] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:49.969459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:49.970100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:49.976346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:49.976784 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:49.977540 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:49.978563 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:50.044917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:50.052562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a390fc2a-619f-4f37-8ba7-576f6d3561df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.086739 Nov 24 18:39:50.053129 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1034/2068] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:51.070592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:51.071208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:51.078224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:51.078680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:51.079456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:51.079897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:51.138575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:51.146159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be00a181-9ee7-4172-8429-23e663e3814e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079205 Nov 24 18:39:51.146731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1035/2069] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:52.162819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:52.163417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:52.170689 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:52.171132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:52.171903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:52.172334 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:52.231036 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:52.238550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-31dea331-abbd-485f-b983-71f04d621a7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079360 Nov 24 18:39:52.239111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1035/2070] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:53.255852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:53.256468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:53.262692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:53.263142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:53.263919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:53.264361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:53.324240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:53.332051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9817565-f9ce-42fe-92fa-c0399013fe0a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079824 Nov 24 18:39:53.332626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1036/2071] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:54.349513 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:54.350148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:54.356864 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:54.357318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:54.358117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:54.358559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:54.417670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:54.425369 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3cc4aa03-ef92-42ed-b9e6-6b40091da2bf tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079474 Nov 24 18:39:54.425970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1036/2072] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:55.442417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:55.443015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:55.449205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:55.449646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:55.450434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:55.450870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:55.508154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:55.516122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2ac8b818-d629-4721-9f45-d278c1cb1817 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077344 Nov 24 18:39:55.516684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1037/2073] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:56.533406 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:56.534032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:56.540223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:56.541199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:56.542171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:56.542601 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:56.601424 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:56.610226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e6716e79-005f-4983-8ce8-1680ed577c4a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080732 Nov 24 18:39:56.610781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1037/2074] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:57.627514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:57.628148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:57.634581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:57.635038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:57.636142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:57.636636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:57.694635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:57.702554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8da34a04-d85a-44cc-9f3d-735a2c542e08 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078724 Nov 24 18:39:57.703129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1038/2075] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:58.720297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:58.720921 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:58.727253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:58.727700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:58.728609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:58.728995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:58.786938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:58.795073 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f9df2c36-33eb-4e9b-8f66-a3cc8af7406b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078436 Nov 24 18:39:58.795657 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1038/2076] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:39:59.812111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:39:59.812676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:39:59.818959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:59.819412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:59.820293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:39:59.820734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:39:59.881874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:39:59.890346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6acb4dec-d3c4-45c7-86f3-3bca46df4f13 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081978 Nov 24 18:39:59.890904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1039/2077] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:39:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:00.907111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:00.907675 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:00.913842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:00.914288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:00.915043 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:00.916081 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:00.972630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:00.980801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-683d9055-ef97-4c0c-bf65-1cc5d88055af tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077640 Nov 24 18:40:00.981355 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1039/2078] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:01.997567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:01.998205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:02.004431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:02.004882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:02.005743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:02.006211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:02.064405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:02.072814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5bb3488a-6e96-4a83-9b57-2022ef6193df tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078763 Nov 24 18:40:02.073385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1040/2079] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:03.089482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:03.090148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:03.096535 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:03.096985 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:03.097772 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:03.098218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:03.226743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:03.234694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6790621b-509f-419b-9755-5a0f41bf69ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.148977 Nov 24 18:40:03.235260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1040/2080] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:04.252290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:04.252893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:04.259102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:04.259555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:04.260497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:04.260934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:04.371912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:04.379702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2db981c8-dbb1-4c5f-94e3-b7f43504d7e2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.131098 Nov 24 18:40:04.380295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1041/2081] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:05.396163 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:05.396773 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:05.404135 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:05.404584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:05.405346 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:05.406047 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:05.468153 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:05.475743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7be87985-9ca9-4d6d-9d37-a44531ccb868 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083328 Nov 24 18:40:05.476305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1041/2082] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:06.493576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:06.494216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:06.501196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:06.501641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:06.502442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:06.502880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:06.560882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:06.568934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-abf16c08-6db4-423b-b2b0-ed907ff27b40 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078975 Nov 24 18:40:06.569504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1042/2083] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:07.585694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:07.586372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:07.593262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:07.593715 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:07.594517 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:07.594957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:07.653305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:07.661230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0907f1e6-627f-4dfb-b6c1-2fc0cbfa3dd4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079165 Nov 24 18:40:07.661819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1042/2084] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:08.678798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:08.679400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:08.686294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:08.686735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:08.687491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:08.687932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:08.744519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:08.752721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8bd79089-11de-48af-bdc2-b77434f8552e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077497 Nov 24 18:40:08.753288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1043/2085] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:09.769428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:09.770064 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:09.776544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:09.776999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:09.777829 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:09.779319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:09.846489 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:09.854289 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-02291846-0a12-41cb-8892-82d2b0c08f8b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.088583 Nov 24 18:40:09.854860 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1043/2086] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:10.871145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:10.871734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:10.878676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:10.879122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:10.879886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:10.880319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:10.939122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:10.946721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-19711f7d-a3a1-481c-b244-d049a93d11e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079370 Nov 24 18:40:10.947286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1044/2087] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:11.964623 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:11.965237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:11.971612 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:11.972056 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:11.972824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:11.973257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:12.030909 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:12.038437 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a3588144-e119-41e3-afc5-249b1a3daa7a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077673 Nov 24 18:40:12.039007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1044/2088] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:13.055678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:13.056291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:13.063637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:13.064089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:13.064859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:13.065297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:13.126617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:13.134285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0becd337-342e-4ce9-b8a7-62362d33e2e3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082219 Nov 24 18:40:13.134857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1045/2089] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:14.151034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:14.151639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:14.158274 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:14.158713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:14.159483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:14.159929 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:14.217987 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:14.225644 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f0418207-f5bb-419c-bb24-74ca33846a71 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078277 Nov 24 18:40:14.226241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1045/2090] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:15.241665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:15.242272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:15.249183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:15.249652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:15.250436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:15.250867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:15.308025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:15.316275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-088acc02-96c7-445c-aa6c-10b3d74f70f1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078308 Nov 24 18:40:15.316838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1046/2091] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:16.333058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:16.333639 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:16.339767 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:16.340218 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:16.341482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:16.341968 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:16.400306 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:16.408799 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-37f0f7b3-c4e1-4376-b1ec-31ef6410046c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079463 Nov 24 18:40:16.409362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1046/2092] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:17.425927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:17.426545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:17.433119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:17.433573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:17.435071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:17.435513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:17.494695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:17.503007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-41bbd617-ef13-4be1-82d9-2e2b3b99096c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080818 Nov 24 18:40:17.503580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1047/2093] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:18.519636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:18.520249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:18.526557 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:18.527009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:18.527777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:18.528927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:18.589817 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:18.598083 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6ee0745d-67e1-48d2-88f8-e8b32f0e0c52 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082072 Nov 24 18:40:18.598643 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1047/2094] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:19.614658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:19.615297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:19.622098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:19.622640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:19.623390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:19.623827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:19.681263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:19.689585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-049c59bf-abaa-451b-bcb2-a2f6a565650f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078616 Nov 24 18:40:19.690186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1048/2095] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:20.706698 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:20.707309 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:20.713579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:20.714058 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:20.714830 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:20.715266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:20.773345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:20.782007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7bf3d0df-41b9-498c-b897-521944e347a3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079073 Nov 24 18:40:20.782567 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1048/2096] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:21.798109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:21.798720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:21.805053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:21.805504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:21.806306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:21.806744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:21.864520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:21.872711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0482bd7e-4bc0-460d-a7f0-7dcd09f5a623 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078264 Nov 24 18:40:21.873286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1049/2097] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:22.889943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:22.890631 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:22.897054 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:22.897509 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:22.898318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:22.898757 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:22.957037 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:22.964636 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3dcba098-d0e4-4ee7-9d6f-c091fc8ee1d9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078995 Nov 24 18:40:22.965200 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1049/2098] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:23.982762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:23.983369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:23.989535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:23.990018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:23.990791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:23.991228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:24.048437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:24.056053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-87c615e9-3d58-44d8-868a-9898c6769161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077575 Nov 24 18:40:24.056624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1050/2099] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:25.073948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:25.074562 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:25.080781 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:25.081234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:25.082041 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:25.082479 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:25.140906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:25.148629 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d7fd12b6-c1e7-409c-8972-07cbb0fe407a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078309 Nov 24 18:40:25.149196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1050/2100] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:26.166199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:26.166831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:26.173030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:26.173473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:26.174259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:26.174688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:26.235543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:26.243144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6d2abebf-a568-4e46-873b-946f80d29aa5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080586 Nov 24 18:40:26.243704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1051/2101] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:27.259975 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:27.260608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:27.267603 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:27.270980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:27.270980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:27.270980 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:27.327414 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:27.334992 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8e71dba6-b734-4020-90e0-54180e47417f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079620 Nov 24 18:40:27.335549 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1051/2102] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:28.352101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:28.352713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:28.359761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:28.360213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:28.360982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:28.361421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:28.419080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:28.426814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c8d77392-7927-4672-8415-d85483edbaa4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078375 Nov 24 18:40:28.427377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1052/2103] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:29.444108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:29.444716 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:29.451262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:29.451713 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:29.452495 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:29.452931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:29.512230 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:29.520364 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2e17932f-1e09-4746-b3b2-ead90de61872 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079799 Nov 24 18:40:29.520931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1052/2104] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:29.599279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:40:29.599459 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:40:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:40:30.447119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:40:30.447691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:40:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:40:30.536860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:30.537468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:30.543830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:30.544282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:30.545646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:30.546129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:30.605046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:30.616613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42caf868-15f5-4038-8676-c9bc9dc30595 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083316 Nov 24 18:40:30.617180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1053/2105] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:31.633744 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:31.634314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:31.641201 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:31.641640 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:31.642419 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:31.642848 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:31.705427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:31.713396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-59133b7a-5a7d-48ef-9feb-a6b41d5621a6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083290 Nov 24 18:40:31.713999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1053/2106] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:32.730191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:32.730807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:32.737868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:32.738316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:32.739095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:32.739529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:32.797342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:32.804958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e9442bbf-817e-48cb-ba75-354389b860b0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078497 Nov 24 18:40:32.805521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1054/2107] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:33.823253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:33.823806 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:33.830335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:33.830782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:33.831579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:33.832000 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:33.889991 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:33.897576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-45fbf273-c682-4b7c-8eee-4443e0e0ec67 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078115 Nov 24 18:40:33.898167 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1054/2108] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:34.915049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:34.915692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:34.922646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:34.923100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:34.923870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:34.924309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:34.983167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:34.990664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-722c7b5d-ad0b-4b66-93ba-3e2ec32bbbb3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079288 Nov 24 18:40:34.991227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1055/2109] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:36.007979 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:36.008606 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:36.015873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:36.016322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:36.017094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:36.017528 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:36.076738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:36.085215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5fe2d983-8209-4a1d-bcd8-957aaa3c02d7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080842 Nov 24 18:40:36.086007 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1055/2110] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:37.102372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:37.102980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:37.109981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:37.110420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:37.111181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:37.111608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:37.171629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:37.180013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cc835b36-5c40-4ffb-a6ab-6b00d5089318 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081290 Nov 24 18:40:37.180666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1056/2111] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:40:38.197579 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:38.198286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:38.205248 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:38.205693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:38.206486 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:38.206916 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:38.265910 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:38.273493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d27eace7-609f-4697-9d5d-86e41e3e40ee tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079546 Nov 24 18:40:38.274093 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1056/2112] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:39.291066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:39.291709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:39.298453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:39.298907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:39.299685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:39.300122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:39.602440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:39.610323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9429bb43-be36-42a2-a1b6-749bf2164934 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.322946 Nov 24 18:40:39.610897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1057/2113] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:40.628132 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:40.628743 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:40.634742 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:40.635192 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:40.635957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:40.636396 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:40.694805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:40.702605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2f97bf6a-7d5f-4a10-8a61-d07bdf8f16dc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078113 Nov 24 18:40:40.703164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1057/2114] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:41.719582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:41.720190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:41.726247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:41.726702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:41.727472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:41.727912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:41.785944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:41.793592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-984d1369-c045-4f79-aef4-dbdef321e451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078848 Nov 24 18:40:41.794189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1058/2115] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:42.811874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:42.812425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:42.818777 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:42.819224 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:42.819995 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:42.820428 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:42.879106 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:42.886768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-14eea78c-4375-4c54-a266-ee74acffd437 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079525 Nov 24 18:40:42.887322 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1058/2116] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:43.904545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:43.905356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:43.911600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:43.912052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:43.912951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:43.913395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:43.971595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:43.979203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c9b9ab4-2954-45c2-bd2c-17b8a7c82df7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078480 Nov 24 18:40:43.979765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1059/2117] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:44.995978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:44.996593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:45.003326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:45.003842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:45.004619 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:45.005057 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:45.067251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:45.074881 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-8488398a-7d4a-4af4-9dd1-cf761feba1ba tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082565 Nov 24 18:40:45.075451 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1059/2118] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:46.091623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:46.092246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:46.098491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:46.098939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:46.099702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:46.100136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:46.158704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:46.166224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eb0ad309-35b0-4b5c-9b17-d5e3672572e1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078305 Nov 24 18:40:46.166790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1060/2119] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:47.183555 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:47.184171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:47.190900 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:47.191343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:47.192105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:47.192559 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:47.252621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:47.260443 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cfd16fc6-ca00-45fd-930c-30d53ecddefd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080557 Nov 24 18:40:47.261482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1060/2120] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:48.277393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:48.278027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:48.284486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:48.284931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:48.285689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:48.286146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:48.345148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:48.352865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-add04d96-8e0f-471a-9058-593bc0aafee1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079096 Nov 24 18:40:48.353431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1061/2121] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:49.378969 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Traceback (most recent call last): Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: timer() Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: cb(*args, **kw) Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: waiter.switch() Nov 24 18:40:49.379560 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: greenlet.error: cannot switch to a different thread Nov 24 18:40:49.554869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:49.555604 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:49.562460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:49.562913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:49.563692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:49.564128 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:49.622243 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:49.630463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d29ca3a3-30a2-4c05-9fa0-7f181af44f5a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.263774 Nov 24 18:40:49.630965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1061/2122] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:50.647670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:50.648300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:50.654711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:50.655412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:50.656170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:50.656601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:50.714903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:50.722398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-32f7d7c2-eae9-41d7-adf0-b5ad333f793f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078299 Nov 24 18:40:50.722957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1062/2123] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:51.739734 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:51.740339 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:51.746545 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:51.746978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:51.747771 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:51.748202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:51.807300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:51.815172 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d5b123e5-e548-4b6c-9e44-88b227b29f55 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079018 Nov 24 18:40:51.815670 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1062/2124] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:52.832054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:52.832682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:52.838847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:52.839293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:52.840063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:52.840497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:52.899576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:52.908208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8703a49a-5213-4a83-8abc-ca148fe76a79 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079732 Nov 24 18:40:52.908871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1063/2125] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:53.924664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:53.925266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:53.931630 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:53.932071 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:53.932828 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:53.933257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:53.991181 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:53.998638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d292ff9c-73d4-4bee-9fc6-64041ec2112a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077570 Nov 24 18:40:53.999204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1063/2126] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:55.015878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:55.016488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:55.022766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:55.023220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:55.023995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:55.024433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:55.083560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:55.091916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-18103eae-976b-4694-977c-c5ba61cb4f66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079595 Nov 24 18:40:55.092601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1064/2127] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:56.109262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:56.109873 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:56.116040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:56.116483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:56.117242 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:56.117671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:56.176001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:56.183519 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cb609b4c-fd45-480d-9f29-fe5d5011c37a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078641 Nov 24 18:40:56.184074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1064/2128] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:57.201004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:57.201752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:57.208055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:57.208511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:57.209300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:57.209736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:57.274994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:57.284118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-da14dc6c-8c07-41b2-8790-b55f63f0e008 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.087466 Nov 24 18:40:57.284701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1065/2129] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:58.300312 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:58.300926 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:58.307216 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:58.307664 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:58.308433 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:58.308867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:58.370046 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:58.378204 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-df7f6bd6-fa2d-4670-be76-669a4ab4d7b6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081495 Nov 24 18:40:58.378762 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1065/2130] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:40:59.394071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:40:59.394680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:40:59.400994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:59.401440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:59.402231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:40:59.402703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:40:59.462303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:40:59.470590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-916b379a-e4ae-40c1-8c4e-e8386e22c603 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080157 Nov 24 18:40:59.471147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1066/2131] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:40:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:00.487401 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:00.488020 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:00.494331 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:00.494783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:00.495554 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:00.495994 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:00.554091 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:00.562534 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fab652ea-60d2-4a91-bd2b-3ff68e7b58b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078849 Nov 24 18:41:00.563100 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1066/2132] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:01.579564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:01.580184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:01.586486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:01.586933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:01.587731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:01.588168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:01.649075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:01.657420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-31f2ce76-e07a-4ac3-8f89-0f2e1f02f1fd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082472 Nov 24 18:41:01.658015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1067/2133] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:41:02.674638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:02.675254 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:02.681611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:02.682099 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:02.682869 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:02.683308 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:02.740769 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:02.749164 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d5f42ea-b700-4a25-822b-b7a101b56d14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078234 Nov 24 18:41:02.749722 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1067/2134] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:03.765690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:03.766336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:03.772464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:03.772907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:03.773663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:03.774124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:03.831825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:03.839390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5179c18b-263f-425a-8afa-e3254c676494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077879 Nov 24 18:41:03.839929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1068/2135] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:04.857217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:04.857927 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:04.864139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:04.864575 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:04.865336 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:04.865787 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:04.924202 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:04.931850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-030e0f8c-845b-48c5-a447-8fd84b3aed8e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078880 Nov 24 18:41:04.932408 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1068/2136] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:05.948607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:05.949209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:05.956153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:05.956604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:05.957404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:05.957870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:06.015268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:06.022872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-28ddc9b3-32de-4b6d-b62a-6b7e000d3abb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077876 Nov 24 18:41:06.023441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1069/2137] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:05 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:07.040139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:07.040843 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:07.047981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:07.048432 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:07.049212 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:07.049651 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:07.108928 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:07.116879 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-acc3c397-6a28-4975-b876-9638b82c5e33 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080309 Nov 24 18:41:07.117463 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1069/2138] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:08.133404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:08.134039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:08.140639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:08.141090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:08.141906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:08.142346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:08.200593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:08.208100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1bdb5d7f-a251-462f-a16c-fa370763e4ff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078304 Nov 24 18:41:08.208841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1070/2139] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:09.225211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:09.225854 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:09.232383 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:09.232833 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:09.233608 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:09.234079 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:09.292409 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:09.300276 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9fbab02c-719d-48d4-a5c0-d80347ba56e0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078725 Nov 24 18:41:09.300832 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1070/2140] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:10.316611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:10.317194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:10.323100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:10.323547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:10.324305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:10.324764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:10.383589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:10.392486 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c970ae08-e524-42f4-aed1-d846e90cdc3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079548 Nov 24 18:41:10.393052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1071/2141] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:11.408541 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:11.409222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:11.415142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:11.415590 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:11.416382 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:11.416816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:11.480514 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:11.488808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cb9574e0-0a4b-4091-83cc-8631121b7f25 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084156 Nov 24 18:41:11.489370 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1071/2142] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:12.506121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:12.506732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:12.513103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:12.513558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:12.514361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:12.514804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:12.573412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:12.581296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-27e89c98-5dd0-4fd0-a403-61ffdea69c89 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078823 Nov 24 18:41:12.581872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1072/2143] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:13.598935 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:13.599553 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:13.605779 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:13.606295 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:13.607105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:13.607544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:13.664791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:13.673237 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cda17b23-087e-4911-ad70-5425d4f4e286 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077997 Nov 24 18:41:13.673818 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1072/2144] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:14.690938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:14.691526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:14.697678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:14.698157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:14.698923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:14.699356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:14.761382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:14.769608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4e97e16d-fde7-4c5b-8128-3dcafff97f3f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082281 Nov 24 18:41:14.770162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1073/2145] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:15.785981 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:15.786587 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:15.792766 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:15.793211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:15.794368 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:15.794816 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:15.853940 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:15.861752 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b6c361c0-1e7f-45b2-ad9e-c6c4edf7ff2e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079430 Nov 24 18:41:15.862335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1073/2146] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:41:16.878605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:16.879180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:16.885224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:16.885665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:16.886458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:16.886889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:16.944548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:16.952461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-64425f07-97fb-4bb0-87e2-651f531d368a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077535 Nov 24 18:41:16.953024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1074/2147] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:17.969197 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:17.969807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:17.976023 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:17.976467 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:17.977220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:17.977648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:18.035600 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:18.043161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b9d1c78b-493b-43e2-8609-50a8621a56c2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077751 Nov 24 18:41:18.043793 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1074/2148] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:17 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:19.059944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:19.060547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:19.066778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:19.067221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:19.067980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:19.068408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:19.125505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:19.133048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ccb26662-53b0-4c5b-9659-ed72fed5b033 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.076927 Nov 24 18:41:19.133601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1075/2149] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:20.150010 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:20.150625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:20.157904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:20.158360 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:20.159168 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:20.159609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:20.217616 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:20.225214 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-eafc7475-5c8a-4a97-84e5-190222fa497f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078866 Nov 24 18:41:20.225834 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1075/2150] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:21.242532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:21.243128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:21.249569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:21.250052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:21.250847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:21.251283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:21.310469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:21.318015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71b1ab10-0a39-4797-b5e1-c97ecb3fe2f8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079105 Nov 24 18:41:21.318578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1076/2151] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:41:22.335183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:22.335790 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:22.342004 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:22.342460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:22.343211 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:22.343641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:22.401217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:22.409607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1f86e6b4-90a1-48b0-b369-be9c2520f451 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078034 Nov 24 18:41:22.410217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1076/2152] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:23.426511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:23.427113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:23.433252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:23.433693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:23.434570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:23.434999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:23.493331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:23.501114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-97109e4f-5429-44f7-b9b8-c32cd8a302d2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078199 Nov 24 18:41:23.501677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1077/2153] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:24.517561 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:24.518195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:24.524415 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:24.524855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:24.525607 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:24.526059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:24.587983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:24.595896 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fa0c230c-ec42-48ce-9b56-362fe6f28971 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081916 Nov 24 18:41:24.596458 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1077/2154] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:25.612444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:25.613046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:25.619210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:25.619656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:25.620448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:25.620881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:25.679784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:25.688297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-31def6c7-5932-4340-9b0c-eafa965cfa27 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079449 Nov 24 18:41:25.688862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1078/2155] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:26.705434 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:26.706065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:26.712394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:26.712844 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:26.713613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:26.714074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:26.772427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:26.781492 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3088def8-5b4f-422e-ba8c-c0c2bf9303ed tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079563 Nov 24 18:41:26.781993 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1078/2156] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:27.798594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:27.799197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:27.805314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:27.805773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:27.806546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:27.806976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:27.867650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:27.875263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-06edab60-5abb-4f7e-ae14-c2677677bb04 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080245 Nov 24 18:41:27.875823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1079/2157] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:28.892104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:28.892660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:28.898924 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:28.899374 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:28.900137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:28.900568 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:28.959241 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:28.966865 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cc0fd53c-3d47-4a9f-9ce4-6a1d7dffd7c0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078555 Nov 24 18:41:28.967435 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1079/2158] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:29.984465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:29.985095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:29.991384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:29.991835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:29.992604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:29.993042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:30.056368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:30.064758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6eaf38a-252b-4677-a43f-8947ab4fa21a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084640 Nov 24 18:41:30.065326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1080/2159] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:29 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:41:31.080996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:31.081584 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:31.087826 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:31.088285 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:31.089066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:31.089500 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:31.147185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:31.155180 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a59828b0-7972-427c-9108-dd761f6730cb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077783 Nov 24 18:41:31.155747 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1080/2160] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:32.173046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:32.173686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:32.179933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:32.180386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:32.181152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:32.181587 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:32.239045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:32.246905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e7243a88-5906-4609-8182-45461a262ad3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077721 Nov 24 18:41:32.247469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1081/2161] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:33.263235 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:33.263838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:33.270059 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:33.270465 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:33.271220 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:33.271646 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:33.330450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:33.338033 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-0e86e19c-5255-412c-a7be-6f5abe129e97 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078436 Nov 24 18:41:33.338597 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1081/2162] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:34.354595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:34.355193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:34.362114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:34.362567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:34.363334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:34.363771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:34.421399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:34.429126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10f28b15-b791-42e8-b711-a5ce276753fc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078187 Nov 24 18:41:34.429689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1082/2163] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:35.446266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:35.446876 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:35.454176 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:35.454622 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:35.455385 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:35.455813 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:35.513193 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:35.520733 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-626bae64-436a-42e5-b9ed-a5691661e006 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078146 Nov 24 18:41:35.521290 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1082/2164] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:36.538638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:36.539245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:36.547231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:36.547677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:36.548443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:36.548875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:36.609810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:36.617378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a232f07-042f-4e75-a712-edd5cac1372e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082374 Nov 24 18:41:36.617989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1083/2165] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:37.633768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:37.634400 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:37.641527 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:37.642006 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:37.642782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:37.643222 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:37.705329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:37.713249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-aa81e5d1-1822-4ba4-9cec-f2ba1bcbb25b tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083116 Nov 24 18:41:37.713868 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1083/2166] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:38.729842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:38.730457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:38.737415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:38.737907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:38.738677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:38.739117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:38.797836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:38.805442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b527aaa-f8a6-401b-b51f-d544ac0be0b2 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079198 Nov 24 18:41:38.806047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1084/2167] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:39.821647 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:39.822232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:39.829232 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:39.829684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:39.830476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:39.830913 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:39.888283 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:39.896684 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-d252023c-e6d3-4433-a57c-dd29ace82740 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078724 Nov 24 18:41:39.897249 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1084/2168] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:39 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:40.913537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:40.914202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:40.920659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:40.921107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:40.921893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:40.922327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:40.982983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:40.990691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2cde5288-c602-4a72-967f-6ef8373326de tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080756 Nov 24 18:41:40.991255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1085/2169] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:42.007901 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:42.008506 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:42.015221 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:42.015663 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:42.016422 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:42.016850 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:42.073460 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:42.081711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-32796723-6f37-49e6-a243-20528d35dfd6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077404 Nov 24 18:41:42.082297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1085/2170] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:43.098160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:43.098785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:43.105026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:43.105480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:43.106284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:43.106723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:43.164268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:43.172349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48813d84-472c-40bb-92c7-e94151fe4a14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077791 Nov 24 18:41:43.172941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1086/2171] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:44.189482 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:44.190142 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:44.196362 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:44.196812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:44.197577 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:44.198034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:44.258147 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:44.266580 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1b0ad4b1-c0da-4fb3-9655-20c6ce440a57 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081570 Nov 24 18:41:44.267150 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1086/2172] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:45.283367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:45.283965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:45.290131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:45.290571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:45.291325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:45.291754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:45.348857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:45.356260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-da1b0aac-efb9-42f5-ab38-3fd672d925cd tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.076486 Nov 24 18:41:45.356822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1087/2173] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:46.374305 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:46.374917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:46.381116 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:46.381574 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:46.382379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:46.382819 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:46.441174 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:46.448782 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-39278fe3-5aea-4190-afeb-ab5d0bf37db8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078872 Nov 24 18:41:46.449345 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1087/2174] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:47.466255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:47.467600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:47.473826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:47.474279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:47.475049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:47.475485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:47.534770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:47.542392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f76afab-ac1d-4538-b0ff-24acd3ce3861 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079855 Nov 24 18:41:47.542958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1088/2175] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:48.559040 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:48.559648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:48.566679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:48.567139 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:48.567904 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:48.568340 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:48.627257 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:48.634841 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-a1028f0e-e713-4373-beac-e9d6a49c559f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079472 Nov 24 18:41:48.635402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1088/2176] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:49.652016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:49.652623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:49.659490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:49.659945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:49.660721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:49.661195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:49.718984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:49.726527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eace010c-4c70-4f8b-b98f-7aee9509ec14 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078230 Nov 24 18:41:49.727097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1089/2177] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:50.744186 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:50.744812 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:50.752008 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:50.752454 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:50.753217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:50.753654 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:50.816175 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:50.823737 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7df3a03f-e2b2-4544-99e9-b6bedc8fb7b1 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083228 Nov 24 18:41:50.824297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1089/2178] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:50 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:51.840906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:51.841441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:51.848151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:51.848592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:51.849346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:51.849795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:51.908696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:51.916258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1283fcf6-a57d-4ebc-a210-092e4a989c6f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079053 Nov 24 18:41:51.916813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1090/2179] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:51 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:52.933016 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:52.933626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:52.940906 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:52.941354 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:52.942156 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:52.942593 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:53.001349 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:53.008914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-bc3e980a-8b21-4e40-b4fc-ee604ff6ce20 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079538 Nov 24 18:41:53.009477 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1090/2180] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:52 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:54.025749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:54.026388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:54.033166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:54.033619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:54.034418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:54.034856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:54.096400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:54.104271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8035e929-18d0-446a-ae4a-02f2dcaf6161 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082160 Nov 24 18:41:54.104836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1091/2181] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:54 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:55.120096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:55.120711 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:55.127842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:55.128288 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:55.129066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:55.129504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:55.187768 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:55.195363 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9d1521dd-7f50-434b-8569-3415e7ad092e tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078930 Nov 24 18:41:55.195930 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1091/2182] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:55 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:56.212014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:56.212654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:56.219737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:56.220189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:56.220970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:56.221409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:56.280788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:56.288575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-49df3f43-9de6-4df5-8d15-a7914acf0c69 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080282 Nov 24 18:41:56.289143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1092/2183] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:56 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:57.306022 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:57.306618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:57.312859 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:57.313314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:57.315199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:57.315199 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:57.373938 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:57.381925 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f558998b-502c-499c-a0f7-7901834af5a7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079682 Nov 24 18:41:57.382493 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1092/2184] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:57 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:58.398817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:58.399440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:58.406590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:58.407047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:58.407815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:58.408255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:58.466914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:58.474567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-60de6aef-cbdf-466f-a0bb-4b6b5f771494 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079436 Nov 24 18:41:58.475135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1093/2185] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:58 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:41:59.491350 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:41:59.491957 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:41:59.499001 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:59.499453 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:59.500217 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:41:59.500652 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:41:59.560755 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:41:59.568626 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-4f1de573-5f87-4b7f-87e6-0d5fef88c572 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080899 Nov 24 18:41:59.569178 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1093/2186] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:41:59 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:00.584867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:00.585506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:00.597167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:00.597624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:00.598437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:00.598873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:00.658532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:00.666054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2819f158-eec8-4217-8b4d-d8c568d75a1c tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084835 Nov 24 18:42:00.666623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1094/2187] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:00 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:01.683789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:01.684402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:01.691726 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:01.692117 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:01.692889 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:01.693326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:01.751086 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:01.758695 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f7dce4a0-0712-4d70-be5a-a0cf37ae2107 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078587 Nov 24 18:42:01.759251 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1094/2188] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:01 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:02.775228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:02.775832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:02.782368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:02.782811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:02.783567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:02.783997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:02.841647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:02.849170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-120efa8f-0c86-448a-8832-03ccd9542659 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077537 Nov 24 18:42:02.849719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1095/2189] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:02 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:03.866104 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:03.866679 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:03.873693 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:03.874173 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:03.874956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:03.875393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:03.936803 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:03.944618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3b6a83c8-8643-4676-a719-a4920f3e3041 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082266 Nov 24 18:42:03.945195 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1095/2190] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:03 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:04.960258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:04.960870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:04.967184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:04.967629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:04.968391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:04.968825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:05.027029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:05.035901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-19a7c8ff-c729-4637-baa6-04a4b5ff1f16 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079233 Nov 24 18:42:05.036462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1096/2191] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:04 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:06.052931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:06.053551 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:06.060446 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:06.061066 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:06.061877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:06.062319 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:06.120439 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:06.128923 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b4b74e9d-b678-4948-ad07-6a7f16237593 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079631 Nov 24 18:42:06.129496 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1096/2192] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:06 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:07.146010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:07.147306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:07.156485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:07.156935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:07.157781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:07.158221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:07.221570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:07.229385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-177b6436-2f51-4ad5-8ef6-95c871b1bd76 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.087434 Nov 24 18:42:07.229984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1097/2193] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:07 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:08.246594 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:08.247754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:08.254586 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:08.255032 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:08.255796 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:08.256231 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:08.317102 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:08.324783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-b44bfc69-e99b-4044-97eb-4a7ac4b7487a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081807 Nov 24 18:42:08.325393 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1097/2194] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:08 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:09.342417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:09.343045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:09.349163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:09.349604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:09.350394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:09.350820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:09.409031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:09.416899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cd3187ab-eb90-43ad-8b2a-9e52ae39c42d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078750 Nov 24 18:42:09.417471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1098/2195] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:09 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:10.433789 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:10.434391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:10.441155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:10.441611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:10.442402 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:10.442838 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:10.502697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:10.510314 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-cafa2a09-fc73-4cca-a410-7dd01c09f446 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080374 Nov 24 18:42:10.510874 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1098/2196] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:10 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:11.527172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:11.527801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:11.534452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:11.534923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:11.535679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:11.536106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:11.594552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:11.602114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e873cf0b-1210-4961-b7d4-e393bb6a14eb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078732 Nov 24 18:42:11.602663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1099/2197] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:11 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:12.617609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:12.618271 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:12.624697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:12.625149 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:12.625956 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:12.626399 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:12.683617 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:12.691379 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-04bfba1f-1969-40f4-86f9-39fa5f4a1ac8 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077425 Nov 24 18:42:12.691949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1099/2198] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:12 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:13.708202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:13.708837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:13.715010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:13.715457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:13.716783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:13.717219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:13.776482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:13.784536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4633ed90-29c4-4a91-9783-032016ca5e58 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079944 Nov 24 18:42:13.785110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1100/2199] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:13 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:14.801062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:14.801824 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:14.808111 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:14.808566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:14.809347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:14.809944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:14.868177 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:14.876279 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2144f94f-0052-4ac6-9cdc-338e5e963fbc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078943 Nov 24 18:42:14.876903 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1100/2200] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:14 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:15.892733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:15.893421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:15.899399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:15.899837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:15.900588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:15.901016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:15.959194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:15.967360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d79956bf-ebc7-4feb-9896-ba5fdd7cd215 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078314 Nov 24 18:42:15.967921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1101/2201] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:15 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:42:16.984700 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:16.985326 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:16.991531 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:16.991965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:16.992723 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:16.993148 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:17.054537 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:17.062749 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dbee7d70-02e2-4232-87a6-d461be8e77b5 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.082186 Nov 24 18:42:17.063347 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1101/2202] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:16 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:18.079920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:18.080511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:18.086680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:18.087121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:18.087879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:18.088306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:18.146201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:18.154004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ea9bff1e-69f9-440e-a89e-5528c144e757 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077696 Nov 24 18:42:18.154562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1102/2203] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:18 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:19.170999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:19.171595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:19.177717 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:19.178187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:19.178945 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:19.179392 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:19.237136 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:19.244729 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-5ac308ac-88c4-4cd4-a19e-009515386902 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077908 Nov 24 18:42:19.245286 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1102/2204] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:19 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:20.262691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:20.263544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:20.269393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:20.269873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:20.270648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:20.271089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:20.331942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:20.339586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d40ef46b-2d77-414e-81b0-575c47a570e9 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080635 Nov 24 18:42:20.340151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1103/2205] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:20 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:21.357300 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:21.357914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:21.364096 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:21.364544 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:21.365307 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:21.365738 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:21.423976 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:21.431550 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-2fe56b1f-6069-4ed8-a4e0-5eb860bc9807 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078575 Nov 24 18:42:21.432108 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1103/2206] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:21 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:22.448313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:22.448963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:22.455458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:22.455918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:22.456668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:22.457105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:22.514678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:22.522364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c2ccd1e5-b551-4e2a-ab99-4e98f63ac018 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077782 Nov 24 18:42:22.522937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1104/2207] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:22 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:23.539732 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:23.540366 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:23.546753 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:23.547215 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:23.547983 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:23.548417 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:23.606581 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:23.614227 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-7c91d180-a33d-4288-b855-0f3277d77e43 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078162 Nov 24 18:42:23.614798 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1104/2208] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:23 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:24.630988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:24.631594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:24.638555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:24.638999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:24.639762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:24.640194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:24.697127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:24.705402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-45f0344f-286d-4805-bcb8-b2428e938336 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078142 Nov 24 18:42:24.706002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1105/2209] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:24 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:25.722503 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:25.723105 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:25.729253 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:25.729697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:25.730483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:25.730912 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:25.791618 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:25.799470 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-9026f32c-2f76-45bc-b533-9c89c751cadb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080591 Nov 24 18:42:25.800038 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1105/2210] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:25 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:26.815937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:26.816473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:26.822649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:26.823097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:26.823862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:26.824300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:26.882696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:26.890551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7aed14a-5839-4e24-bc01-a0762dc1e093 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078338 Nov 24 18:42:26.891128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1106/2211] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:26 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:27.908019 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:27.908611 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:27.914745 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:27.915187 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:27.915948 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:27.916372 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:27.973450 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:27.981539 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-937ebfd2-a3c3-4e15-a223-e3ff5cd79230 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.076728 Nov 24 18:42:27.982269 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1106/2212] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:27 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:28.997955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:28.998540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:29.004835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:29.005274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:29.006061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:29.006490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:29.063962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:29.071434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9819ce6-cdcd-4029-9247-ce528cd288d3 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077796 Nov 24 18:42:29.071991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1107/2213] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:28 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:30.087999 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:30.088613 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:30.094978 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:30.095427 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:30.096198 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:30.096638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:30.157388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:30.165025 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-6fd0553a-a1b9-4e32-8446-3e3aca19623d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080649 Nov 24 18:42:30.165595 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1107/2214] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:30 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:30.568217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:30.568711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:42:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:31.182242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:31.182843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:31.189346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:31.189839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:31.190610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:31.191047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:31.249338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:31.256911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6169decd-e024-466f-9809-c26f4c87ad66 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078300 Nov 24 18:42:31.257480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1108/2215] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:31 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:32.274123 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:32.274791 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:32.282352 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:32.282805 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:32.283576 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:32.284014 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:32.342965 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:32.350621 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-e134e03c-8c09-4870-99e6-e7fb1d7cbbce tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.080076 Nov 24 18:42:32.351196 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1108/2216] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:32 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:33.367955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:33.368534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:33.375335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:33.375771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:33.376527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:33.376954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:33.439501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:33.447352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0e13aba9-7434-4f46-ae1c-fd2bc8e6d461 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083073 Nov 24 18:42:33.447922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1109/2217] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:33 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:34.463943 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:34.464566 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:34.470785 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:34.471234 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:34.472009 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:34.472452 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:34.531065 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:34.538821 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-3961dfe4-b15b-47c7-b1f8-ebf2a40edcfb tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078519 Nov 24 18:42:34.539391 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1109/2218] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:34 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:35.099459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:35.099999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:42:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:35.556181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:35.556803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:35.563936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:35.564385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:35.565148 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:35.565579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:35.783423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:35.790992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c48c424-76e8-418f-b20c-abae0f12a569 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.238483 Nov 24 18:42:35.791541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1110/2219] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:35 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:36.807842 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:36.808388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:36.815161 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:36.815605 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:36.816358 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:36.816783 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:36.877936 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:36.885469 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-f8711c80-8aaf-4e15-b168-987200ed64e6 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081338 Nov 24 18:42:36.886127 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1110/2220] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:36 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:37.122660 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:37.123388 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:42:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:37.902372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:37.903189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:37.910258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:37.910713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:37.911516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:37.911956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:37.969146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:37.976921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-616c8cd5-d375-4628-9a79-19675967edff tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078294 Nov 24 18:42:37.977478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1111/2221] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:37 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:38.993697 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:38.994335 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:39.000642 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:39.001089 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:39.001883 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:39.002329 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:39.060398 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:39.067877 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-dfac24c3-67e4-4eb1-88f3-ce5d3642e7cc tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077832 Nov 24 18:42:39.068433 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1111/2222] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:38 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:40.085142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:40.085795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:40.091656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:40.092936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:40.093713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:40.094183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:40.151230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:40.159938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-17e7935c-28d4-41a5-a5e1-9916389f573a tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078588 Nov 24 18:42:40.160491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1112/2223] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:40 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:41.177131 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:41.177727 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:41.183931 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:41.184376 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:41.185133 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:41.185699 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:41.243015 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:41.250648 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-099829f2-56f6-4337-a26e-4d16c6c9885f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077264 Nov 24 18:42:41.251213 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1112/2224] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:41 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:42.267295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:42.267900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:42.274102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:42.274556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:42.275327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:42.275766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:42.333648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:42.341568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-30db8266-d517-44ea-a673-2b657b12039f tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.078031 Nov 24 18:42:42.342153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1113/2225] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:42 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:43.358155 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:43.359440 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:43.365808 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:43.366262 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:43.367034 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:43.367472 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:43.430310 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:43.438074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-1798c93b-7e64-4fd5-bcd2-29ae96904735 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.083478 Nov 24 18:42:43.438638 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1113/2226] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:43 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:44.455178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:44.455851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:44.461986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:44.462440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:44.463210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:44.463643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:44.522843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:44.531697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3661ffa6-d7d6-4195-811c-8e583496ebe7 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.081181 Nov 24 18:42:44.532244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1114/2227] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:44 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:45.548343 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:45.548944 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:45.555260 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:45.555709 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:45.556483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:45.556917 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:45.614502 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:45.622062 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-03092566-131c-448a-b9af-7507de4c6472 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.077491 Nov 24 18:42:45.622625 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1114/2228] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:45 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:46.640254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:46.640967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:46.648263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:46.648714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:46.649489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:46.649967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:46.712030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:46.720341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6c5fc8b-e5fb-4c22-80a7-afded836ce94 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.084263 Nov 24 18:42:46.720893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1115/2229] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:46 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:47.738867 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:47.739476 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:47.748160 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:47.748609 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:47.749855 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:47.750297 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:47.810914 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:47.818949 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-905dc89e-8a76-4966-87c3-9048c2e4f520 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.085725 Nov 24 18:42:47.819507 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1115/2230] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:47 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:48.836056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:48.836629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:48.842926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:48.843536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:48.844304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:48.844751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:48.903777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:48.911573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4939b1fa-6f6f-4578-be00-953cdfe05427 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079300 Nov 24 18:42:48.912127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1116/2231] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:48 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:49.928084 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:49.928694 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.compute.api [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116731) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:49.934970 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:49.935438 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:49.936185 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:49.937183 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG oslo_concurrency.lockutils [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:49.995504 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.policy [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca31b3f0de0341cd8bea5261d9c90f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323752ad15674bad99bd523cbe98c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116731) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:50.003807 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO nova.api.openstack.requestlog [None req-fe09825b-d1bc-477d-b175-30292279c298 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 200 len: 1369 microversion: 2.1 time: 0.079383 Nov 24 18:42:50.004367 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: [pid: 116731|app: 0|req: 1116/2232] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:49 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:42:50.020972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7649579d-5427-4eba-970f-9ae2e3e7dda4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '.version_select at 0x7f8bacd2c160>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:50.110093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7649579d-5427-4eba-970f-9ae2e3e7dda4 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247169567" status: 202 len: 0 microversion: 2.1 time: 0.092583 Nov 24 18:42:50.110684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1117/2233] 10.222.0.53 () {58 vars in 1220 bytes} [Wed Nov 24 18:42:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247169567 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:42:51.141754 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.api.openstack.wsgi [None req-50d8337e-001c-4088-b7c7-c46bbebb895d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Action: 'create', calling method: .version_select at 0x7f8ba88b2940>, body: {"keypair": {"name": "tempest-keypair-1219488641"}} {{(pid=116731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:42:51.156226 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-50d8337e-001c-4088-b7c7-c46bbebb895d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:42:51.160425 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: DEBUG nova.quota [None req-50d8337e-001c-4088-b7c7-c46bbebb895d tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Getting quotas for user ca31b3f0de0341cd8bea5261d9c90f87 and project 323752ad15674bad99bd523cbe98c9a5. Resources: {'key_pairs'} {{(pid=116731) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:42:53.325915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:53.326417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:53.335249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:53.335249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:53.335249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:53.335249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:53.360221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:42:53.674466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7214b1bc-687c-4b60-abfa-c1e36ef7e6d1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 204 len: 0 microversion: 2.1 time: 0.352304 Nov 24 18:42:53.675049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1118/2234] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:42:53 2021] DELETE /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:42:53.682767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:53.683461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:53.689674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:53.695427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:53.695427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:53.695427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:53.822693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:53.830010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-797efc2e-aa64-436a-9d97-f75090e66ce1 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1515 microversion: 2.1 time: 0.150902 Nov 24 18:42:53.830591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1119/2235] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:53 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:42:54.699802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-9ed783f8-4eec-4af0-823a-7febc627770a req-fb628761-b1f1-4518-8d5a-4c66f0dd0731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b745d4a2-f3c5-40fa-8ebd-cb36682d6977", "name": "network-vif-deleted", "tag": "b99dff2d-61b7-450e-9db5-f2b2a2a87439"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:42:54.701395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:42:54.701395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:42:54.708488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9ed783f8-4eec-4af0-823a-7febc627770a req-fb628761-b1f1-4518-8d5a-4c66f0dd0731 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:54.708922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9ed783f8-4eec-4af0-823a-7febc627770a req-fb628761-b1f1-4518-8d5a-4c66f0dd0731 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:54.720032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-9ed783f8-4eec-4af0-823a-7febc627770a req-fb628761-b1f1-4518-8d5a-4c66f0dd0731 service nova] Creating event network-vif-deleted:b99dff2d-61b7-450e-9db5-f2b2a2a87439 for instance b745d4a2-f3c5-40fa-8ebd-cb36682d6977 on hv-cinder-80403 Nov 24 18:42:54.724961 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-9ed783f8-4eec-4af0-823a-7febc627770a req-fb628761-b1f1-4518-8d5a-4c66f0dd0731 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097803 Nov 24 18:42:54.725556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1120/2236] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:42:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:42:54.848233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:54.848953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:54.855025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:54.855475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:54.856247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:54.856686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:54.919456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf4f94ef33c406f86a393463f4f20c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1725839d8ee14641976a34987403c3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:42:54.926974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-847112b0-1400-4cdd-b020-c373f41942a3 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 200 len: 1303 microversion: 2.1 time: 0.082960 Nov 24 18:42:54.927532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1121/2237] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:54 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:42:55.943780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:42:55.944482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] [instance: b745d4a2-f3c5-40fa-8ebd-cb36682d6977] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:42:55.950766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:55.951221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:55.952000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:42:55.952440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:42:55.965493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] HTTP exception thrown: Instance b745d4a2-f3c5-40fa-8ebd-cb36682d6977 could not be found. Nov 24 18:42:55.966147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] Returning 404 to user: Instance b745d4a2-f3c5-40fa-8ebd-cb36682d6977 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:42:55.967060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0fe8fcc5-bb6a-4ff8-98f7-04070572f2a2 tempest-AttachVolumeNegativeTest-545381191 tempest-AttachVolumeNegativeTest-545381191-project] 10.222.0.53 "GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977" status: 404 len: 111 microversion: 2.1 time: 0.027004 Nov 24 18:42:55.967610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1122/2238] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:42:55 2021] GET /compute/v2.1/servers/b745d4a2-f3c5-40fa-8ebd-cb36682d6977 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:42:58.386081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-162b798c-ab91-490b-a60d-d88d05a2b937 tempest-VolumesSnapshotsTestJSON-1277898147 tempest-VolumesSnapshotsTestJSON-1277898147-project] Action: 'create', calling method: .version_select at 0x7f8bacc8d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1444782075"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:43:49.616692 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:43:49.617223 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:43:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:43:50.464150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:43:50.464729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:43:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.53) !!! Nov 24 18:44:53.394097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-162b798c-ab91-490b-a60d-d88d05a2b937 tempest-VolumesSnapshotsTestJSON-1277898147 tempest-VolumesSnapshotsTestJSON-1277898147-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 115.118513 Nov 24 18:44:53.394931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1123/2239] 10.222.0.53 () {60 vars in 1154 bytes} [Wed Nov 24 18:42:58 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 115120 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 24 18:45:05.591039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:05.591709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:05.597975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.598431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:05.599250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.599691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:05.623972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:45:05.915943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9639f963-bc25-4b07-bc0f-05a1a9ab27e9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "DELETE /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 204 len: 0 microversion: 2.1 time: 0.329047 Nov 24 18:45:05.916584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1124/2240] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:45:05 2021] DELETE /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:45:05.921430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:05.922068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:05.928979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.929427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:05.930242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.930682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:05.943749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. Nov 24 18:45:05.944337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:45:05.945149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b8e9ebb8-0580-448f-8140-96e0b2fdfffc tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 404 len: 111 microversion: 2.1 time: 0.027512 Nov 24 18:45:05.945675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1125/2241] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:45:05 2021] DELETE /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:45:05.949847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:05.951432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:05.955864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.956314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:05.957085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:05.957559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:06.244963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:06.253024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6039d6d5-8559-42b1-a750-b4c33a0b91d2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1508 microversion: 2.1 time: 0.306353 Nov 24 18:45:06.254988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1126/2242] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:05 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:45:06.258898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:06.259504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] [instance: 837cce81-17da-4d50-ae72-0fa0765ffb36] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:06.265194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:06.265645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:06.266560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:06.267051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:06.280306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] HTTP exception thrown: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. Nov 24 18:45:06.280885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] Returning 404 to user: Instance 837cce81-17da-4d50-ae72-0fa0765ffb36 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:45:06.281692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-842e07a5-a5c6-4c38-90a8-0597a3c78b3b tempest-AttachVolumeShelveTestJSON-521657762 tempest-AttachVolumeShelveTestJSON-521657762-project] 10.222.0.53 "GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36" status: 404 len: 111 microversion: 2.1 time: 0.026842 Nov 24 18:45:06.282270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1127/2243] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:06 2021] GET /compute/v2.1/servers/837cce81-17da-4d50-ae72-0fa0765ffb36 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:45:07.000444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-281c307b-00c2-4805-a8c4-52631b40b796 req-c1acf7c3-e08d-41a1-9a68-69e69552f104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e99700-926e-462b-8a89-0775c74dd646", "name": "network-vif-deleted", "tag": "61bdcb5e-0080-4d16-9417-4fd71e519487"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:45:07.015502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:45:07.015502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:45:07.015502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-281c307b-00c2-4805-a8c4-52631b40b796 req-c1acf7c3-e08d-41a1-9a68-69e69552f104 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:07.015502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-281c307b-00c2-4805-a8c4-52631b40b796 req-c1acf7c3-e08d-41a1-9a68-69e69552f104 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:07.023599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-281c307b-00c2-4805-a8c4-52631b40b796 req-c1acf7c3-e08d-41a1-9a68-69e69552f104 service nova] Creating event network-vif-deleted:61bdcb5e-0080-4d16-9417-4fd71e519487 for instance 97e99700-926e-462b-8a89-0775c74dd646 on hv-cinder-80403 Nov 24 18:45:07.030752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-281c307b-00c2-4805-a8c4-52631b40b796 req-c1acf7c3-e08d-41a1-9a68-69e69552f104 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Nov 24 18:45:07.033288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1128/2244] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:45:07.272849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:07.273564 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:07.280815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:07.281365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:07.282165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:07.282600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:07.313154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:07.313595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:07.314061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'fault' on Instance uuid 97e99700-926e-462b-8a89-0775c74dd646 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:45:07.412648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:07.412648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bb881f96-bc59-4d3e-bae1-eb396e278bf9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 200 len: 1312 microversion: 2.1 time: 0.123738 Nov 24 18:45:07.412648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1129/2245] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:07 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:08.408458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:08.410057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 97e99700-926e-462b-8a89-0775c74dd646] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:08.417028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.417477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:08.418282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.418715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:08.432211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] HTTP exception thrown: Instance 97e99700-926e-462b-8a89-0775c74dd646 could not be found. Nov 24 18:45:08.432799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Returning 404 to user: Instance 97e99700-926e-462b-8a89-0775c74dd646 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:45:08.433619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-030e834f-5f64-4ea6-acf7-4379c2c5d53c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646" status: 404 len: 111 microversion: 2.1 time: 0.029128 Nov 24 18:45:08.434380 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1130/2246] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:08 2021] GET /compute/v2.1/servers/97e99700-926e-462b-8a89-0775c74dd646 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:45:08.442226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:08.442729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:08.449070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.449525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:08.450340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.450775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:08.475785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:45:08.772235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f1e17c89-6820-4797-b8b4-3afa5f4694fb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 204 len: 0 microversion: 2.1 time: 0.332803 Nov 24 18:45:08.779295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1131/2247] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:45:08 2021] DELETE /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:45:08.781933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:08.782191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:08.789041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.789490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:08.790322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:08.790762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:09.044814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:09.057029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0aaa5975-a1b7-41f7-b207-f2cb5ed3a8c9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1568 microversion: 2.1 time: 0.279442 Nov 24 18:45:09.057890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1132/2248] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:45:09.953903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-9a8b3d01-80d9-4727-891d-700f0bb00c45 req-490d79c3-6c38-49f4-988e-ddc9b3700dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01eba79d-7c56-4ad4-8a6d-b3084fb1952f", "name": "network-vif-deleted", "tag": "877d6e7f-90a3-43eb-baa7-350d90ba0215"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:45:09.956233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:45:09.956233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:45:09.964048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9a8b3d01-80d9-4727-891d-700f0bb00c45 req-490d79c3-6c38-49f4-988e-ddc9b3700dac service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:09.964582 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9a8b3d01-80d9-4727-891d-700f0bb00c45 req-490d79c3-6c38-49f4-988e-ddc9b3700dac service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:09.976458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-9a8b3d01-80d9-4727-891d-700f0bb00c45 req-490d79c3-6c38-49f4-988e-ddc9b3700dac service nova] Creating event network-vif-deleted:877d6e7f-90a3-43eb-baa7-350d90ba0215 for instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f on hv-cinder-80403 Nov 24 18:45:09.982281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-9a8b3d01-80d9-4727-891d-700f0bb00c45 req-490d79c3-6c38-49f4-988e-ddc9b3700dac service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032144 Nov 24 18:45:09.982915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1133/2249] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:45:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:45:10.079331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:10.080272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:10.087646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:10.088096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:10.088884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:10.089319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:10.151827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:10.163479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14bab06f-b7fe-4d31-bec6-eccd597e903b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.088136 Nov 24 18:45:10.163976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1134/2250] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:45:11.179824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:11.188223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:11.188223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:11.188223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:11.188223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:11.188681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:11.249664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:11.259540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8f82548b-d19c-46c4-aacb-470a0f7346bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081761 Nov 24 18:45:11.259540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1135/2251] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:12.274374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:12.275045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:12.281241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:12.281683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:12.282478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:12.282908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:12.342322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:12.351387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fad85e65-1458-468b-ade9-964c2db50b3a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080767 Nov 24 18:45:12.352167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1136/2252] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:13.368691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:13.369362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:13.375519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:13.375972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:13.376745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:13.377188 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:13.434654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:13.442151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6bbe5395-389f-41e4-9a70-6f58874737e3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077925 Nov 24 18:45:13.442722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1137/2253] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:14.459982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:14.460891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:14.466788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:14.467241 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:14.467989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:14.468415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:14.526613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:14.534222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d623823d-c315-4432-bf53-1766cbfc08ad tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078470 Nov 24 18:45:14.534779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1138/2254] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:15.551137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:15.551835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:15.558632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:15.559101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:15.559852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:15.560282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:15.617966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:15.625473 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2853175f-c604-4f03-8538-25e6fb18f011 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077967 Nov 24 18:45:15.626058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1139/2255] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:16.642841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:16.643333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:16.650152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:16.650605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:16.651382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:16.651818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:16.708897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:16.716666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c87d3bb5-aa65-4f44-9e65-c3d8fe5816f1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077688 Nov 24 18:45:16.717229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1140/2256] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:17.733630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:17.734356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:17.740512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:17.741642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:17.742474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:17.742916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:17.805292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:17.813054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4de4d762-a021-4a35-8eab-27b6f4ef7422 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083096 Nov 24 18:45:17.813546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1141/2257] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:18.829600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:18.830298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:18.836511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:18.836962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:18.837737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:18.838205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:18.895845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:18.903976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be7eda80-b26d-4ba4-b62a-53e79b1b6447 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078107 Nov 24 18:45:18.904542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1142/2258] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:19.920581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:19.921226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:19.927402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:19.927850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:19.929721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:19.930186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:19.987135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:19.995870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef71e9a8-83d4-4393-9302-d31e7459b511 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079007 Nov 24 18:45:19.996433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1143/2259] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:21.012838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:21.013514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:21.019696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:21.020154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:21.020930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:21.021370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:21.080609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:21.088910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c4874e37-ab9d-4ef2-bc58-0b0a7e8b5a39 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079956 Nov 24 18:45:21.089476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1144/2260] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:22.105947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:22.106645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:22.112708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:22.113156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:22.113954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:22.114389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:22.171561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:22.179841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a5465ea2-e46f-44c2-9255-2e3969014c73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077579 Nov 24 18:45:22.180392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1145/2261] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:23.197231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:23.197967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:23.204063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:23.204505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:23.205273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:23.205703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:23.262939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:23.270387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1384a75c-339b-42dc-ab9b-38805b169659 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.076919 Nov 24 18:45:23.276310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1146/2262] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:24.291394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:24.292107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:24.298202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:24.298645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:24.299412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:24.299842 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:24.361501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:24.370165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ce41f713-2e28-4711-87e8-dfaf60f67c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083043 Nov 24 18:45:24.370740 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1147/2263] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:25.386372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:25.387061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:25.393107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:25.393552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:25.394349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:25.394781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:25.453065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:25.460682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-604e8551-395b-4e37-97e7-7a13c92aeecc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078595 Nov 24 18:45:25.461334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1148/2264] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:26.476139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:26.476844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:26.482935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:26.483383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:26.484146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:26.484579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:26.543238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:26.550871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f3785d08-e1fa-4689-94f8-2e83262a7880 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078429 Nov 24 18:45:26.551448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1149/2265] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:27.567484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:27.568087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:27.575454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:27.575910 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:27.576723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:27.577196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:27.635590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:27.643319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7e64d0a8-291f-463e-ab8f-e9d003d2f610 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079518 Nov 24 18:45:27.643884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1150/2266] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:28.660296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:28.660902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:28.667941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:28.668384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:28.669139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:28.669569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:28.728399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:28.736238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7a9c8014-21f5-45c0-9ccf-197910200692 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079511 Nov 24 18:45:28.736804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1151/2267] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:29.752781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:29.753478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:29.760451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:29.760901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:29.761709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:29.762170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:29.820562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:29.828275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cf92b54d-b673-463e-9c09-9d1b63a1b66a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079242 Nov 24 18:45:29.828838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1152/2268] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:30.844973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:30.845605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:30.852463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:30.852911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:30.853677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:30.854138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:30.916555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:30.924219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-078b5166-a3f8-42ab-af7b-1e542f6acbaa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083009 Nov 24 18:45:30.924787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1153/2269] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:31.940096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:31.940795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:31.947531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:31.947981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:31.949084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:31.949526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:32.010503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:32.018047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c875c73-4ed2-4646-a927-96f12a8ab33b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081560 Nov 24 18:45:32.018606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1154/2270] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:33.035422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:33.036186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:33.042312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:33.042767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:33.043539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:33.043984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:33.101635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:33.109579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-01cb9d3a-6e1c-4a82-8c28-5dfb0911c333 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077899 Nov 24 18:45:33.110191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1155/2271] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:34.126345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:34.127071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:34.134013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:34.134467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:34.135248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:34.135685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:34.193033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:34.201130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a0039cff-aaf1-4f32-999a-06614fda0287 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078442 Nov 24 18:45:34.201703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1156/2272] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:35.217359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:35.218064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:35.224359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:35.224816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:35.225591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:35.226087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:35.285237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:35.293722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e058ea0a-cf5f-4541-b5ac-f3d5960f3561 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080040 Nov 24 18:45:35.294319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1157/2273] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:36.310687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:36.311344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:36.317731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:36.318213 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:36.318985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:36.319528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:36.380105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:36.388454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c3548062-8e52-4555-be00-94421bd96229 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081573 Nov 24 18:45:36.389015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1158/2274] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:37.404950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:37.405655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:37.411756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:37.412206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:37.412972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:37.413409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:37.475860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:37.484290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d763f3d-657d-422c-a1c6-20fe76e1f370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082966 Nov 24 18:45:37.484859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1159/2275] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:38.505462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:38.506201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:38.513210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:38.513656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:38.514455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:38.514892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:38.574769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:38.582565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9547f534-879c-42ad-a0fd-fd937105c6ac tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080752 Nov 24 18:45:38.583126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1160/2276] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:39.600161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:39.600820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:39.607674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:39.608125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:39.608900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:39.609339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:39.667585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:39.675249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-05d52a5a-ab1f-43ae-93bf-e05525a05370 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078740 Nov 24 18:45:39.675814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1161/2277] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:40.691713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:40.692329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:40.698986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:40.699436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:40.700208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:40.700645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:40.759329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:40.766998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-31cc1acc-5896-49fc-8608-8399fba3f655 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078988 Nov 24 18:45:40.767562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1162/2278] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:41.783384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:41.784076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:41.790878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:41.791341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:41.792145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:41.792586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:41.849554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:41.857955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1d81f8e-f7a0-487a-ac0b-3ab9b150a50b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078174 Nov 24 18:45:41.858515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1163/2279] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:42.874448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:42.875089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:42.881076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:42.881519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:42.882370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:42.882813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:42.940326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:42.949050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-40fee8f3-731a-444c-bf90-5967bf1a5c31 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078337 Nov 24 18:45:42.949619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1164/2280] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:43.966071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:43.966768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:43.972917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:43.973368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:43.974178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:43.974620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:44.037529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:44.045273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c12ad43-0604-4f26-a1c2-6d6da043bf87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082850 Nov 24 18:45:44.045855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1165/2281] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:45.062958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:45.063659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:45.070081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:45.070627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:45.071412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:45.071885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:45.130212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:45.138411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9a84629-c71d-4538-96e9-c8363a3ddec0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079107 Nov 24 18:45:45.138981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1166/2282] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:46.155097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:46.155805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:46.161914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:46.162365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:46.163139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:46.164085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:46.222063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:46.230431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5611e655-87aa-48c4-aff4-8a08007b5a64 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079017 Nov 24 18:45:46.230990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1167/2283] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:47.247067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:47.247769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:47.253938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:47.254393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:47.255206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:47.255648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:47.316087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:47.324832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-389b6324-3dba-4914-bc8f-13a12680dc87 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081482 Nov 24 18:45:47.325405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1168/2284] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:48.342535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:48.343324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:48.349353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:48.349834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:48.350607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:48.351526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:48.409779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:48.417484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-af3b3dfd-899a-4a00-a198-8eaa609d4977 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078700 Nov 24 18:45:48.418084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1169/2285] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:49.434117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:49.434836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:49.440981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:49.441431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:49.442237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:49.442674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:49.499685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:49.507452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6560008a-efe4-47f8-b240-9dc700cfeb0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.076976 Nov 24 18:45:49.508016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1170/2286] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:50.524887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:50.525585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:50.531797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:50.532249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:50.533022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:50.533460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:50.594699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:50.602460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-91803630-167e-4bf7-8305-afad34ed50cd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082176 Nov 24 18:45:50.603052 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1171/2287] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:51.801793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:51.802439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:51.808192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:51.808578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:51.809341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:51.809796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:51.867291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:51.874917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a03a1104-e7f9-4db4-9e9b-a9e7cab6377a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.259500 Nov 24 18:45:51.875482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1172/2288] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:52.890804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:52.891428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:52.898510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:52.899104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:52.899707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:52.900146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:52.956917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:52.965419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-74894b92-14f4-45bb-8b1e-13e1d6bfd071 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078351 Nov 24 18:45:52.966028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1173/2289] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:53.982212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:53.982884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:53.988984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:53.989435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:53.990232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:53.990672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:54.049934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:54.058536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-920f19dd-800d-4abf-b668-844a1ae2dca2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079975 Nov 24 18:45:54.059100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1174/2290] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:55.075636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:55.076301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:55.082498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:55.082952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:55.083730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:55.084168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:55.117633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:45:55.117908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:45:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f (ip 10.222.0.53) !!! Nov 24 18:45:55.145926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:55.154225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3250bcee-4c4b-497c-9aa6-2deddf6b3198 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082281 Nov 24 18:45:55.154796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1175/2291] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:56.171342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:56.172054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:56.178218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:56.178695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:56.179468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:56.179906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:56.238076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:56.246111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e0a698b5-c6a6-4c5b-b9f3-0e47072412c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078379 Nov 24 18:45:56.246681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1176/2292] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:57.140665 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:45:57.141266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:45:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:45:57.263374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:57.264018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:57.270297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:57.270748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:57.271526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:57.271966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:57.334023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:57.342754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a8cbe0dc-230a-4fc2-bde1-f0456c3d9c1f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082985 Nov 24 18:45:57.344108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1177/2293] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:58.359464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:58.360166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:58.366743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:58.367186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:58.367958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:58.368388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:58.426178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:58.434302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee7546f9-0e79-49d3-a9b6-48ae5e1fca55 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078530 Nov 24 18:45:58.434858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1178/2294] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:45:59.450589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:45:59.451293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:45:59.457382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:59.457860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:59.458631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:45:59.459064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:45:59.518363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:45:59.526951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b5137ae-b197-48fc-866f-a4c05830fb91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080011 Nov 24 18:45:59.527512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1179/2295] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:45:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:00.544285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:00.544952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:00.551026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:00.551463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:00.552230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:00.552664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:00.611480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:00.619169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-529a8d9e-db58-4330-80e1-e21926582f42 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078517 Nov 24 18:46:00.619725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1180/2296] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:01.635846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:01.636541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:01.642772 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:01.645517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:01.645517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:01.645517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:01.703845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:01.712279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f1d97141-9af1-4470-9e42-070eb63d0ad5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080317 Nov 24 18:46:01.712771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1181/2297] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:02.728219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:02.728838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:02.735015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:02.735464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:02.736232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:02.736665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:02.797387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:02.805952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ba5a8810-b072-4ba4-ad13-14a7f95e9165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081377 Nov 24 18:46:02.806515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1182/2298] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:03.824322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:03.825013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:03.831162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:03.831615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:03.832386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:03.832824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:03.893848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:03.902854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-49fd0e87-bf28-456b-b7cb-69d6086fd361 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082295 Nov 24 18:46:03.903415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1183/2299] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:04.919431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:04.920075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:04.926233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:04.926683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:04.927450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:04.927886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:04.986089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:04.994686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b2e790c-633b-4900-9035-6434c031446d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078916 Nov 24 18:46:04.995257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1184/2300] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:06.011968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:06.012658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:06.018979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:06.021075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:06.021075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:06.021075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:06.079161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:06.087184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-77ca7cd2-f772-4414-929b-006a6e2e699a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078948 Nov 24 18:46:06.087756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1185/2301] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:07.104060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:07.104739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:07.110998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:07.111449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:07.112220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:07.112656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:07.170902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:07.179226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-65357c21-e1d8-4938-b8e2-e95c215d1873 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078745 Nov 24 18:46:07.179795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1186/2302] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:08.196070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:08.196758 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:08.202889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:08.203338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:08.204105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:08.204539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:08.263735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:08.271421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b3552e89-9993-4875-a3f2-acf996ff6f1e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079684 Nov 24 18:46:08.271993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1187/2303] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:09.289208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:09.289823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:09.297275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:09.297722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:09.298512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:09.298946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:09.357411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:09.365028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1216194d-a99b-4073-b0e6-9cea9125dd73 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080105 Nov 24 18:46:09.365594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1188/2304] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:10.382627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:10.383323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:10.389072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:10.389519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:10.390349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:10.390782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:10.452519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:10.460905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-760fb8dc-3796-4c8d-879e-90a894a046d9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082439 Nov 24 18:46:10.461480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1189/2305] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:46:11.477976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:11.478685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:11.484986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:11.485443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:11.486251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:11.486689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:11.545144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:11.552899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e0f0ce2a-d06d-4157-b8f1-0d21bca7992c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079219 Nov 24 18:46:11.554500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1190/2306] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:12.570948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:12.571592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:12.577856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:12.578315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:12.579081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:12.579513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:12.637362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:12.644977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-804b7cd0-be45-43b1-9340-595159f6d31d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078499 Nov 24 18:46:12.645543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1191/2307] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:13.662003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:13.662699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:13.669500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:13.669994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:13.670776 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:13.671215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:13.729781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:13.737447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-63987031-4b23-41e0-98cb-5503af6d13fa tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079093 Nov 24 18:46:13.738050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1192/2308] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:14.753008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:14.753643 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:14.760524 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:14.760981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:14.761752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:14.762208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:14.822245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:14.829941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-87cee705-fe80-47a8-8b50-1db150c181ce tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080562 Nov 24 18:46:14.833104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1193/2309] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:15.847671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:15.848334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:15.855187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:15.855636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:15.856414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:15.856853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:15.915703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:15.923456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a358ecad-3e57-4452-be1b-0ed80b808645 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079558 Nov 24 18:46:15.924022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1194/2310] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:16.940128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:16.940791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:16.947451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:16.947906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:16.948676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:16.949117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:17.009542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:17.017218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8e251ab-7b32-450d-a1cd-d1e3e382b77c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080740 Nov 24 18:46:17.017807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1195/2311] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:18.034602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:18.035261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:18.042292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:18.042748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:18.043530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:18.043968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:18.102100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:18.109847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6626d197-aca6-407e-8c34-a186baa428c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078899 Nov 24 18:46:18.110412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1196/2312] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:19.127207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:19.127870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:19.134296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:19.134751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:19.135521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:19.135959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:19.194272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:19.201869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cba29133-7e0e-484b-8b6f-d51568fb9ed8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078283 Nov 24 18:46:19.202435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1197/2313] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:20.218158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:20.218858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:20.225677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:20.226146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:20.226922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:20.227352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:20.287823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:20.295780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10e8abfe-ef12-45af-a331-b2da2e38ec5d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081237 Nov 24 18:46:20.296348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1198/2314] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:21.312680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:21.313361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:21.320024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:21.320475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:21.321247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:21.321682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:21.379827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:21.388181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ee29c627-25aa-48ca-9909-5565c2053288 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079156 Nov 24 18:46:21.388748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1199/2315] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:22.404156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:22.404886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:22.410944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:22.411396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:22.412163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:22.412859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:22.470809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:22.479382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-afe785eb-3e7e-448d-b4eb-0dfde3ae1fda tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078922 Nov 24 18:46:22.479952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1200/2316] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:23.496301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:23.497001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:23.503082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:23.503527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:23.504290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:23.504723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:23.566387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:23.575485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-515b00d1-8587-4c16-be18-074998f6ded2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082943 Nov 24 18:46:23.576045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1201/2317] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:24.591882 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:24.592517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:24.598712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:24.599161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:24.600886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:24.601337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:24.659516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:24.667898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6d6b677e-24e7-45d7-b989-fa319c13f0c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079646 Nov 24 18:46:24.668475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1202/2318] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:25.684793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:25.685440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:25.691707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:25.692150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:25.692913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:25.693350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:25.750827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:25.758997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4ac909da-1bb9-45fd-bdbd-42dd76087e09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077880 Nov 24 18:46:25.759555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1203/2319] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:26.776183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:26.776793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:26.782975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:26.783425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:26.784187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:26.784620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:26.843150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:26.851755 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b919c1b8-4126-477a-a2b9-c16267715ef2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080034 Nov 24 18:46:26.852317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1204/2320] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:27.868764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:27.869427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:27.875468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:27.875918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:27.876687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:27.877123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:27.936804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:27.945306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-507a2d75-4eac-4d9b-8568-a9d4327db0e0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080837 Nov 24 18:46:27.945900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1205/2321] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:28.962955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:28.963618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:28.969812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:28.970261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:28.971027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:28.971462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:29.030117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:29.038749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c98833d4-a7c8-49a4-a144-36cf0de09776 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080520 Nov 24 18:46:29.039323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1206/2322] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:30.055753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:30.056462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:30.062661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:30.063114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:30.063901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:30.064330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:30.125572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:30.134000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-56b501fa-819a-48a6-a66b-7c0ff34f074f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082777 Nov 24 18:46:30.134580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1207/2323] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:31.151405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:31.152084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:31.158407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:31.158856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:31.159632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:31.160078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:31.218945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:31.227272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f3542a2-ebcc-4f85-9324-12bbe312ef21 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079907 Nov 24 18:46:31.227847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1208/2324] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:32.244044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:32.244765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:32.250950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:32.251427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:32.252199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:32.252635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:32.312202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:32.320507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c58066ab-32a8-4384-9823-963ec5c69c90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080420 Nov 24 18:46:32.321086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1209/2325] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:33.337656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:33.338315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:33.344404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:33.344847 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:33.345611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:33.346071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:33.407004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:33.419097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-86895910-c090-47f1-a042-58bde58c7165 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.085807 Nov 24 18:46:33.419665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1210/2326] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:34.436514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:34.437308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:34.443828 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:34.444350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:34.445112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:34.445549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:34.503892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:34.511940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-74a4bb72-3ec8-412e-95ac-d64335df16be tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079102 Nov 24 18:46:34.512496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1211/2327] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:35.528435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:35.529137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:35.535498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:35.535953 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:35.536742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:35.537333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:35.595546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:35.603364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a6fb7fa4-8620-4030-a888-215be7abbbbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078555 Nov 24 18:46:35.603940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1212/2328] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:36.619290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:36.619934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:36.626183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:36.626661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:36.627425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:36.627855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:36.690418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:36.698651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d678eab0-d666-4075-a696-cd4db5c0e7d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082995 Nov 24 18:46:36.699223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1213/2329] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:37.715532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:37.716194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:37.722478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:37.722934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:37.723713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:37.724154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:37.784245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:37.792633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7e59defa-530b-430a-b453-8f9563928763 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080885 Nov 24 18:46:37.793206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1214/2330] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:38.810614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:38.811253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:38.817343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:38.817834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:38.818616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:38.819062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:38.876711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:38.884419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3e587176-128c-47d1-b7d7-ca56cef2c039 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077728 Nov 24 18:46:38.884987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1215/2331] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:39.901278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:39.901963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:39.907640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:39.908091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:39.908858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:39.909296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:39.967726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:39.975871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-90e53d2a-5a5c-4e8e-8116-fc8c176a9f3e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078749 Nov 24 18:46:39.976438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1216/2332] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:40.992370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:40.993075 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:40.999185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:40.999634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:41.000396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:41.000827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:41.058893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:41.066469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-701ccbc9-6114-49a3-bfeb-0f20cb84e9fd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077953 Nov 24 18:46:41.067037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1217/2333] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:42.083709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:42.084390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:42.090696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:42.091150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:42.091925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:42.092368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:42.150562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:42.158262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6dc24b6-ab7f-4ec2-b995-796c2e7a8c65 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078231 Nov 24 18:46:42.158840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1218/2334] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:43.174738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:43.175427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:43.182272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:43.182715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:43.183494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:43.183906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:43.246175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:43.253924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c53e3b1-0c6e-4d88-ab16-62d309c13d26 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082699 Nov 24 18:46:43.254497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1219/2335] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:44.270955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:44.271745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:44.278814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:44.279269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:44.280037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:44.280477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:44.338045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:44.346038 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fc24fa19-f54c-438c-9b9a-0af60bbe9b8f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078754 Nov 24 18:46:44.346623 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1220/2336] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:45.363204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:45.363903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:45.370257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:45.370702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:45.371465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:45.371895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:45.431475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:45.439308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b38ca2af-8685-4140-a813-6fb0b1f14c11 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079762 Nov 24 18:46:45.439871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1221/2337] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:46.456074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:46.456797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:46.462927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:46.463369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:46.464172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:46.464575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:46.523693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:46.531581 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a41cc1c-4d34-43ac-aa8c-e0618f53f0df tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079116 Nov 24 18:46:46.532149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1222/2338] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:47.548227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:47.548917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:47.556531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:47.556990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:47.558285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:47.558541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:47.618272 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:47.626007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2dbcc12c-ca75-4bf2-9d73-bbf87cbbae09 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081436 Nov 24 18:46:47.626616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1223/2339] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:48.643122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:48.643766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:48.650986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:48.651434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:48.652201 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:48.652630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:48.711017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:48.718690 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2cc7bfd1-ff91-4351-888d-36bd341c8dee tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079303 Nov 24 18:46:48.719252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1224/2340] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:49.735288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:49.735967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:49.742627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:49.743077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:49.743844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:49.744279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:49.808589 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:49.816303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2adc0351-6377-491d-b163-82d9157a4a1b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.084675 Nov 24 18:46:49.816860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1225/2341] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:50.832159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:50.832768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:50.839290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:50.839748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:50.840525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:50.840972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:50.899306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:50.907301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5d566a51-bb08-41d6-8441-7b44eacb4968 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078854 Nov 24 18:46:50.907903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1226/2342] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:51.924863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:51.925536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:51.932394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:51.932839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:51.933606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:51.934063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:51.991989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:51.999475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-17b998ed-7ab8-4d47-b7c1-67b0b751a68d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078270 Nov 24 18:46:52.000031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1227/2343] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:46:53.016186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:53.016858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:53.023669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:53.024132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:53.024903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:53.025346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:53.083522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:53.092047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78a88dab-8c19-4669-b097-3da624558406 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079530 Nov 24 18:46:53.092616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1228/2344] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:54.108215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:54.108900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:54.116392 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:54.116863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:54.117604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:54.118066 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:54.179268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:54.186402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f1d6784-f87f-4888-9718-2cd7c2c8cfbd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081904 Nov 24 18:46:54.186962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1229/2345] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:55.203541 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:55.204229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:55.210440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:55.210891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:55.211660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:55.212098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:55.269705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:55.277838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1fd5caf0-915f-46c7-ae06-38d1cbedef10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077959 Nov 24 18:46:55.278402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1230/2346] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:56.295336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:56.295992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:56.302109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:56.302558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:56.304026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:56.304467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:56.366640 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:56.374353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ef723780-e581-4bf3-bd41-932eecdbcd2b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082722 Nov 24 18:46:56.375124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1231/2347] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:57.391962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:57.392669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:57.400062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:57.400518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:57.401292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:57.401732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:57.461239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:57.469156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-af1304e7-78eb-4f12-a53e-78542d50d91f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080997 Nov 24 18:46:57.470193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1232/2348] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:58.486000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:58.486709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:58.493035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:58.493483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:58.494274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:58.494709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:58.553501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:58.561351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-26d92845-0d02-4d73-93db-5eca76d9a647 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078978 Nov 24 18:46:58.561952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1233/2349] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:46:59.578064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:46:59.578680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:46:59.585869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:59.586341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:59.587094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:46:59.587533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:46:59.645641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:46:59.654255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c51b54da-e10e-4f43-8266-2ae67612a0e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079911 Nov 24 18:46:59.654817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1234/2350] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:46:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:00.670638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:00.671314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:00.677428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:00.678535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:00.679291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:00.679722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:00.737290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:00.745802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3454fc29-8e73-4525-8017-7cffa45112b1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078805 Nov 24 18:47:00.746360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1235/2351] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:01.762906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:01.763560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:01.769749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:01.770230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:01.771005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:01.771448 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:01.829807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:01.837496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-60b378fa-b14a-4a58-b848-788674b15d46 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078522 Nov 24 18:47:01.838096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1236/2352] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:02.855597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:02.856278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:02.865037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:02.865498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:02.866297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:02.866735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:02.932296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:02.941737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-90e6ff89-fba8-41b7-ab1a-66d178ef95de tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.091657 Nov 24 18:47:02.942346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1237/2353] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:03.958876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:03.960115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:03.966444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:03.966900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:03.967676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:03.968117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:04.026902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:04.034534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-039415cb-072b-46d1-8f62-6a5da8313daf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079344 Nov 24 18:47:04.035104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1238/2354] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:05.051707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:05.052410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:05.059442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:05.059895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:05.060675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:05.061113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:05.120729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:05.129384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-18886b1c-fa12-421b-8ae6-c4bcd7928e68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080853 Nov 24 18:47:05.129998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1239/2355] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:06.146143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:06.147596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:06.153674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:06.154157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:06.154928 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:06.155374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:06.217296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:06.225646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f2aa72cb-4957-47de-bc93-fd78b1d0f4eb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082477 Nov 24 18:47:06.226266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1240/2356] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:07.242226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:07.242914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:07.248947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:07.249398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:07.250193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:07.250627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:07.309299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:07.316983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c8bfc7e2-a690-4c2f-b18f-5db8a5b37739 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078548 Nov 24 18:47:07.317544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1241/2357] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:08.333012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:08.333669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:08.340411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:08.340858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:08.341630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:08.342097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:08.401977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:08.410012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be0a369b-6451-4513-9716-e13513249d47 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080565 Nov 24 18:47:08.410584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1242/2358] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:09.427020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:09.427711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:09.434683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:09.435072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:09.435853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:09.436290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:09.494664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:09.502492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7faa901e-4521-45de-ad37-07e12a8e1dd3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079181 Nov 24 18:47:09.503063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1243/2359] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:09.635094 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:47:09.635671 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:47:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:47:10.481386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:47:10.481991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:47:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:47:10.518767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:10.519370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:10.526115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:10.526559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:10.527315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:10.527742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:10.586221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:10.593962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ab9e7e31-f653-4642-9091-58cdda4c7a0f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078640 Nov 24 18:47:10.594521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1244/2360] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:11.610187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:11.611305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:11.618484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:11.619061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:11.619863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:11.620307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:11.679554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:11.687188 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-76a6c615-48cb-4c3f-a9ca-bbe72f0c861b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080698 Nov 24 18:47:11.687778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1245/2361] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:12.703658 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:12.704342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:12.711594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:12.712044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:12.712816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:12.713253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:12.778099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:12.785813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8e3e54c3-2b60-4fd8-b4ea-f266aa369d71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.085744 Nov 24 18:47:12.786377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1246/2362] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:13.802988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:13.804027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:13.810391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:13.810775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:13.811540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:13.811973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:13.870787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:13.878408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-45a7fb38-0738-41b7-850b-d98b6f0201f8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079065 Nov 24 18:47:13.878966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1247/2363] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:14.896167 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:14.897613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:14.903858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:14.906501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:14.906501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:14.906501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:14.966086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:14.973824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-35834d70-a599-4591-85c9-ecc65a04c444 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081375 Nov 24 18:47:14.974387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1248/2364] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:15.991280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:15.992526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:15.998862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:15.999315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:16.000094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:16.000537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:16.058416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:16.066068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-07d74710-f8ee-4202-a395-5e4719fdfabb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078706 Nov 24 18:47:16.066629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1249/2365] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:17.082391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:17.083042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:17.089420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:17.089918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:17.090697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:17.091135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:17.149950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:17.157509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3543bf5e-7479-4bc4-a5ed-e22d3169fdfb tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078762 Nov 24 18:47:17.158114 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1250/2366] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:18.174818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:18.175554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:18.182153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:18.182605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:18.183450 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:18.183892 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:18.242378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:18.250240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a44ce491-c290-4af4-b4dd-32108f483cba tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079033 Nov 24 18:47:18.250806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1251/2367] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:19.267388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:19.268132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:19.275105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:19.275550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:19.276452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:19.276801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:19.337904 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:19.345665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23c4ed63-60ad-442f-a67d-b973f49c7cfc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082006 Nov 24 18:47:19.346257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1252/2368] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:20.362527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:20.363232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:20.370058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:20.370509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:20.371283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:20.371723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:20.429672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:20.437342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2d2c3939-d20d-4a6f-b72c-6d2922761d41 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078515 Nov 24 18:47:20.437938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1253/2369] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:21.453347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:21.454079 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:21.461022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:21.461480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:21.462286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:21.462914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:21.521500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:21.529870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-67bbef65-af9d-4405-a856-ee5960667d10 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080114 Nov 24 18:47:21.530434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1254/2370] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:22.546418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:22.547139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:22.553695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:22.554264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:22.555050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:22.555494 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:22.614278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:22.622362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-15190fc9-65d0-49a5-a067-a229b69f9c94 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079214 Nov 24 18:47:22.622934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1255/2371] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:23.639100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:23.639729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:23.646074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:23.646786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:23.647558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:23.648233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:23.706611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:23.714440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5af9516d-2772-4cee-b58c-d8e66fff1f51 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079055 Nov 24 18:47:23.715010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1256/2372] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:24.730971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:24.731586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:24.737846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:24.738306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:24.739078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:24.739518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:24.798869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:24.807097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fff44900-64cf-429e-a676-7afb1c4a8533 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079827 Nov 24 18:47:24.807754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1257/2373] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:25.823921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:25.824580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:25.830738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:25.831195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:25.831970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:25.832409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:25.894965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:25.903250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2fee242c-1905-4f71-b728-72c2e57a425c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083307 Nov 24 18:47:25.903814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1258/2374] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:26.919968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:26.920610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:26.926797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:26.927250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:26.928025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:26.928463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:26.985712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:26.993899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-47fa7044-b862-46c7-b94e-8f7c7533a78c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077691 Nov 24 18:47:26.994466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1259/2375] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:26 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:28.010208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:28.010897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:28.016954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:28.017395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:28.018185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:28.018621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:28.076070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:28.083575 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c98a32ab-c723-434d-90c1-00e3a5a3d8cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077027 Nov 24 18:47:28.084131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1260/2376] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:29.100088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:29.100825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:29.107115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:29.107569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:29.108342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:29.108788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:29.168245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:29.175768 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f621482f-8d0e-47fc-a203-241227c21b9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079338 Nov 24 18:47:29.176329 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1261/2377] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:30.192695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:30.193396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:30.199551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:30.199998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:30.200770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:30.201203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:30.258676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:30.266492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9bcdaea1-0b19-4dfe-b37e-8ffb2da99679 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077415 Nov 24 18:47:30.267064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1262/2378] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:30.586975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:47:30.587154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:47:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:47:31.284023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:31.284700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:31.290998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:31.291438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:31.292198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:31.292624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:31.350371 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:31.358250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-381490b5-4425-43c5-b325-2504d05c98ca tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077837 Nov 24 18:47:31.358822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1263/2379] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:32.375456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:32.376164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:32.382554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:32.383006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:32.383814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:32.384255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:32.445639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:32.453298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95e53130-5558-4567-98c8-7811d3756404 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081562 Nov 24 18:47:32.453881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1264/2380] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:33.471057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:33.471725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:33.478135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:33.478588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:33.479364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:33.479801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:33.538024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:33.551617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8ab85047-3cf9-44fa-95ee-1d6898cf8fc9 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078594 Nov 24 18:47:33.551617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1265/2381] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:34.562909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:34.563520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:34.569717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:34.570195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:34.570972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:34.571411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:34.630802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:34.638670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fb50ada4-fd59-4371-91da-f61db61b4f1c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079430 Nov 24 18:47:34.643523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1266/2382] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:35.656158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:35.656786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:35.663414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:35.663872 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:35.664652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:35.665087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:35.732699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:35.740876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-92e82c50-70f3-4828-a6b5-56594c5bc826 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.088333 Nov 24 18:47:35.741550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1267/2383] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:36.757639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:36.758260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:36.764427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:36.764873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:36.765625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:36.766087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:36.823677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:36.832496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-540701b9-9b21-4f4f-a609-4fc5ffa7c7e8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078442 Nov 24 18:47:36.833520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1268/2384] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:37.849964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:37.851211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:37.856937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:37.857390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:37.858190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:37.858628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:37.918103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:37.925775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1d54017-fb1c-4890-b7ba-87198c68eb2f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079531 Nov 24 18:47:37.926340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1269/2385] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:38.942180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:38.942833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:38.949123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:38.949568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:38.950362 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:38.950792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:39.012316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:39.019942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f3b9190-d9dd-401f-b660-f0163e8800c6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081427 Nov 24 18:47:39.020498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1270/2386] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:38 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:40.036404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:40.037121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:40.043082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:40.043532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:40.044294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:40.044728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:40.101981 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:40.109841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5178be4f-1052-4a7b-b498-69a49c9422d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077018 Nov 24 18:47:40.110434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1271/2387] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:41.126205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:41.126894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:41.134071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:41.134525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:41.135293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:41.135733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:41.193432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:41.201666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e2f218aa-30bf-4a79-8e17-cc2c1eb141bf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079166 Nov 24 18:47:41.202256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1272/2388] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:42.218907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:42.219612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:42.226274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:42.226727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:42.227496 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:42.227937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:42.284930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:42.293511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4ff4d2ef-d0bf-4661-939f-9e1dd454f98d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078244 Nov 24 18:47:42.294101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1273/2389] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:43.310055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:43.310743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:43.316868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:43.317320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:43.318116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:43.318556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:43.376646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:43.384919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c74a1a14-44c5-4c33-a609-e33f4a005c4b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078527 Nov 24 18:47:43.385489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1274/2390] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:44.401789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:44.402465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:44.408530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:44.408973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:44.409728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:44.410187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:44.468251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:44.476396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b622aec1-7f6a-43b5-bd93-f9f0c668ca2e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078348 Nov 24 18:47:44.476962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1275/2391] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:47:45.492898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:45.493590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:45.499747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:45.500200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:45.500976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:45.501416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:45.564159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:45.572168 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-623b1151-b9ef-44ae-8231-e06394916853 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083679 Nov 24 18:47:45.572735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1276/2392] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:46.588637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:46.589248 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:46.595461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:46.595908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:46.596672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:46.597105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:46.654663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:46.662316 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8392a720-a04a-4c9c-a62a-a448dfdcd378 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077852 Nov 24 18:47:46.663502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1277/2393] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:47.679533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:47.680174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:47.686377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:47.686823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:47.687604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:47.688033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:47.747945 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:47.755739 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e9857227-d78f-47fc-a303-0c608486ced2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079964 Nov 24 18:47:47.756303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1278/2394] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:48.773877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:48.774493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:48.780741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:48.781187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:48.781988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:48.782423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:48.840714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:48.848233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4386e3a1-9bb3-4ea5-a63b-927b52157344 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079169 Nov 24 18:47:48.848791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1279/2395] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:49.865531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:49.866802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:49.872898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:49.873343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:49.874135 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:49.874567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:49.932465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:49.940128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14a2435d-1038-40fb-9cff-d07a17935608 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078292 Nov 24 18:47:49.940691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1280/2396] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:50.956070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:50.956715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:50.963745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:50.964188 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:50.964947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:50.965375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:51.023756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:51.031342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-585a7bac-93fc-4466-9704-1cbd24adcf68 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078861 Nov 24 18:47:51.031903 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1281/2397] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:50 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:52.048947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:52.049651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:52.056650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:52.057100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:52.057912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:52.058355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:52.119457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:52.127111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7f2c05ec-8021-4f79-81dd-b3c613470ac5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081785 Nov 24 18:47:52.127682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1282/2398] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:53.143853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:53.144549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:53.151873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:53.152323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:53.153093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:53.153525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:53.212655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:53.220331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-96a2e10d-fea8-4687-9ef3-15cc4cf2badc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080214 Nov 24 18:47:53.220902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1283/2399] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:54.237901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:54.238599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:54.244852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:54.245313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:54.246122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:54.246562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:54.304493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:54.312231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cf52d110-2e3f-4d75-8353-8236a8f60781 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078094 Nov 24 18:47:54.312803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1284/2400] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:47:55.328526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:55.329217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:55.336013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:55.336463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:55.337233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:55.337671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:55.395980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:55.403793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fbf4d1fd-672a-40ab-9f3d-a7a0a5932e01 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078922 Nov 24 18:47:55.404360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1285/2401] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:56.420159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:56.420886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:56.427021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:56.427467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:56.428257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:56.429136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:56.487922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:56.495738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-df7c569b-286f-4ff5-99ac-7f9665b44b82 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079266 Nov 24 18:47:56.496302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1286/2402] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:57.512007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:57.512711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:57.518636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:57.519082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:57.519850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:57.520284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:57.578597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:57.586322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-19e9da15-0e83-4251-813c-f82a75ea3667 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077862 Nov 24 18:47:57.586883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1287/2403] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:58.602382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:58.602996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:58.609224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:58.609681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:58.610485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:58.610924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:58.673408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:58.681952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-26d64cb2-2325-4304-a27e-47c3dc4d9a1a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083257 Nov 24 18:47:58.682519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1288/2404] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:47:59.698719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:47:59.699388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:47:59.705876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:59.706324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:59.707088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:47:59.707520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:47:59.765408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:47:59.773387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c271ee9a-e528-402f-a00e-4da01052aca0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078289 Nov 24 18:47:59.773976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1289/2405] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:47:59 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:00.796252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:00.796853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:00.803143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:00.803596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:00.804548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:00.804990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:00.862952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:00.870935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-deb4e78c-47a1-45e8-a445-ac48bb064b49 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078326 Nov 24 18:48:00.871509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1290/2406] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:01.887977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:01.888611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:01.894883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:01.895584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:01.896345 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:01.896775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:01.955802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:01.963689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-49f0b4c5-43bf-4d82-8200-8df8407b2a71 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079301 Nov 24 18:48:01.964262 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1291/2407] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:48:02.980279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:02.980988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:02.987275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:02.987729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:02.988514 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:02.988956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:03.050118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:03.059020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42a977df-7730-408f-9de9-f95992ffffc0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082263 Nov 24 18:48:03.059607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1292/2408] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:04.080781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:04.081469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:04.087673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:04.088112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:04.088868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:04.089296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:04.147762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:04.155663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b95b9ec-64cb-4564-a9fa-c708aba48500 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078557 Nov 24 18:48:04.156226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1293/2409] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:05.172103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:05.172781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:05.180399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:05.180854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:05.181629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:05.182095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:05.244042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:05.251692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10a86a01-b0e0-476d-b667-955a2ddd09e7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083241 Nov 24 18:48:05.252254 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1294/2410] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:06.267880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:06.268476 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:06.275556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:06.275995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:06.276752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:06.277181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:06.334335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:06.343107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-454aaca3-0f84-42ff-8482-927a8fa3187f tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078851 Nov 24 18:48:06.343672 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1295/2411] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:07.359467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:07.360236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:07.366905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:07.367414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:07.368187 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:07.368627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:07.428133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:07.436002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-52a44d2c-3d8b-4f62-b077-9c04d6950d52 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080185 Nov 24 18:48:07.436583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1296/2412] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:08.452057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:08.452776 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:08.458932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:08.459384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:08.460752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:08.461228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:08.520714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:08.528346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9795893c-4da2-498f-a532-cb801f7ebe90 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079924 Nov 24 18:48:08.528922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1297/2413] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:09.545159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:09.545885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:09.551984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:09.552437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:09.553212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:09.553646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:09.612609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:09.621360 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1dde1f1f-7114-4175-825e-0dbe003287e4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079876 Nov 24 18:48:09.621952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1298/2414] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:10.639214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:10.639906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:10.646356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:10.646812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:10.647600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:10.648031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:10.706744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:10.714538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ffadc3b6-e01d-434c-bf65-cde131218c5c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079222 Nov 24 18:48:10.715095 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1299/2415] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:10 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:11.731445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:11.732080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:11.738398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:11.738844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:11.739608 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:11.740042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:11.802160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:11.817039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-87e15910-9bc5-401e-85f0-857ce6ea478b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.083621 Nov 24 18:48:11.817702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1300/2416] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:48:12.833670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:12.834335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:12.840586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:12.841053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:12.841837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:12.842279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:12.903127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:12.910802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9d78caac-be20-4ee2-8c90-e559efa1051b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080734 Nov 24 18:48:12.911361 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1301/2417] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:13.927546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:13.928231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:13.934862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:13.935310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:13.936076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:13.936512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:13.995491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:14.003121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cedb7c32-b628-4b4d-9c64-03b249fe4fc2 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079288 Nov 24 18:48:14.003686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1302/2418] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:15.020430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:15.021130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:15.027295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:15.027752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:15.028515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:15.028951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:15.087301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:15.095094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-589155bf-ed03-473c-8793-cb5b17df73cc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078581 Nov 24 18:48:15.095688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1303/2419] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:15 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:16.111574 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:16.112274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:16.118441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:16.118880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:16.119638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:16.120067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:16.181133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:16.188706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-be983909-1872-465d-82e8-5d31b01e54c4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080801 Nov 24 18:48:16.189260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1304/2420] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:16 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:17.205110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:17.220710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:17.220710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:17.220710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:17.220710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:17.221174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:17.271894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:17.281086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6a57330b-01a8-4514-9df9-d3dbf8f59649 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079559 Nov 24 18:48:17.281660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1305/2421] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:17 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:18.297632 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:18.298352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:18.304546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:18.305595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:18.306389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:18.306827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:18.364637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:18.372873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4a4cdd6e-499d-467c-aa0f-968dd9143abf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078894 Nov 24 18:48:18.373441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1306/2422] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:18 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:19.390279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:19.390942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:19.397441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:19.397930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:19.398778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:19.399288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:19.460631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:19.468368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-13b87069-681c-44b6-9ad5-8806da3bb937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081824 Nov 24 18:48:19.468933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1307/2423] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:19 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:20.484802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:20.485518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:20.491532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:20.491973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:20.492753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:20.493182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:20.551053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:20.559464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-26bb311c-c217-456f-b692-2c16ac9e47e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078096 Nov 24 18:48:20.560047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1308/2424] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:20 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:21.575593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:21.576274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:21.582403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:21.582844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:21.583600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:21.584057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:21.643130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:21.651833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b7c986ff-01aa-4039-99c4-18813a006937 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079992 Nov 24 18:48:21.657330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1309/2425] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:21 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:22.668914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:22.669585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:22.675819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:22.676289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:22.677041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:22.677479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:22.735175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:22.743057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d99caf2a-47e1-4425-83d7-28e37e7c2fed tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077764 Nov 24 18:48:22.743628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1310/2426] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:22 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:23.758692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:23.759370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:23.766073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:23.766517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:23.767278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:23.767706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:23.826061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:23.833647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-04b73461-4ff8-4994-9830-788ee4f7dfb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078744 Nov 24 18:48:23.834235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1311/2427] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:23 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:24.849510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:24.850196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:24.856925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:24.857376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:24.858182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:24.858628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:24.917184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:24.924985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0b874d01-ab2a-4a5c-86d3-78e32316467c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079297 Nov 24 18:48:24.925552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1312/2428] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:24 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:25.940797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:25.941626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:25.948190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:25.948638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:25.949406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:25.949885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:26.011040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:26.018721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8ce4573a-2ebe-441d-b962-9ac20d13fd62 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081581 Nov 24 18:48:26.019402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1313/2429] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:25 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:27.036176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:27.036836 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:27.043747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:27.044198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:27.044970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:27.045410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:27.104673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:27.112315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-934a6346-da10-49d4-9a75-a6dd161c1769 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079830 Nov 24 18:48:27.112881 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1314/2430] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:27 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:28.129391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:28.130126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:28.136909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:28.137363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:28.138160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:28.138600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:28.196017 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:28.204151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e11f9b00-b046-4b47-8fe9-1d83a64c6ccd tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078467 Nov 24 18:48:28.204705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1315/2431] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:28 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:29.222418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:29.223076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:29.229481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:29.229965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:29.230725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:29.231160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:29.288822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:29.296310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-acd0c3f8-7052-4f9c-804b-40f0cab3e2a1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077559 Nov 24 18:48:29.296866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1316/2432] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:29 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:30.312108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:30.312805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:30.318926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:30.319368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:30.320126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:30.320552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:30.377433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:30.385237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-02585be9-f87f-416c-b217-b0e1a1ad27cf tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.076659 Nov 24 18:48:30.385815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1317/2433] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:30 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:31.402352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:31.403011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:31.417794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:31.417794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:31.417794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:31.417794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:31.469196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:31.477129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dea2beff-c94d-4a68-929c-da4a3c46dee4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079242 Nov 24 18:48:31.477696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1318/2434] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:31 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:32.493439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:32.494215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:32.500312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:32.500763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:32.501537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:32.502011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:32.563968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:32.571653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2270660a-0fa2-4423-b360-63a9080d391a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081853 Nov 24 18:48:32.572224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1319/2435] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:32 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:33.588256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:33.588866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:33.595382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:33.595830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:33.596604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:33.597041 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:33.656207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:33.664098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a61a7ed0-9928-4e6d-8b7a-fce1ebd475e6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079606 Nov 24 18:48:33.664684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1320/2436] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:33 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:34.681855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:34.682510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:34.688730 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:34.689174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:34.689966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:34.690393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:34.748484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:34.756211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-175a0b55-8d94-475b-a1be-3e52dd0b51a3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078705 Nov 24 18:48:34.756782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1321/2437] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:34 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:35.773669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:35.774341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:35.781042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:35.781492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:35.782286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:35.782723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:35.840611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:35.848388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-46c5fdcb-2f7c-4146-8080-a94c688cf9d8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078684 Nov 24 18:48:35.848951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1322/2438] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:35 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:36.865446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:36.866110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:36.873144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:36.873602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:36.874415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:36.874850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:36.933683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:36.941538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ddc38239-b1e0-4299-8e25-7e8b61bd34d1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079798 Nov 24 18:48:36.942152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1323/2439] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:36 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:37.958425 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:37.959171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:37.966184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:37.966639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:37.967415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:37.967854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:38.027471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:38.035127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a1a369e-c8a0-4f95-a702-73a33d72da9c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080399 Nov 24 18:48:38.035693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1324/2440] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:37 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:39.052282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:39.052944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:39.059788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:39.060227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:39.060984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:39.061410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:39.123185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:39.130936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e864c933-d10e-4ad5-a01f-fb518b467ca5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082338 Nov 24 18:48:39.131508 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1325/2441] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:39 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:40.148104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:40.148857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:40.155171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:40.155621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:40.156427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:40.156867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:40.214671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:40.222365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1f31c35b-f799-4cd4-9d65-c323c831b0d6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078326 Nov 24 18:48:40.222934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1326/2442] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:40 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:41.239584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:41.240338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:41.246493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:41.246937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:41.247695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:41.248124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:41.305907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:41.313408 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-df657248-975a-45f8-a315-28a3ff42300e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077530 Nov 24 18:48:41.313991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1327/2443] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:41 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:42.330326 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:42.331032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:42.337137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:42.337956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:42.338698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:42.339131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:42.396364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:42.404087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-413b393a-bf37-4e9d-9ce2-5ca7b0d0953d tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077367 Nov 24 18:48:42.404639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1328/2444] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:42 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:43.420390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:43.421090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:43.427315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:43.427767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:43.428536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:43.428975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:43.487398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:43.495269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-af92a611-25b9-411b-93f2-b03e33e27a2c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078461 Nov 24 18:48:43.495835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1329/2445] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:43 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:44.512171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:44.512893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:44.518941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:44.519649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:44.520469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:44.520901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:44.579441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:44.587088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2c8ce732-300f-4af2-9607-49830f8c347e tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078889 Nov 24 18:48:44.588421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1330/2446] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:44 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:45.603944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:45.604559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:45.610812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:45.611255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:45.612020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:45.612457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:45.674350 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:45.682046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-149412be-c783-4a48-a91c-4972da7d3d59 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082169 Nov 24 18:48:45.682614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1331/2447] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:45 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:46.698094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:46.698812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:46.705084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:46.705536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:46.706330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:46.706778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:46.765731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:46.773729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c5ef7af7-077d-49b0-887b-8a0af1895ad8 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079507 Nov 24 18:48:46.774325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1332/2448] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:46 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:47.791092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:47.791861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:47.798049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:47.798502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:47.799271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:47.799709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:47.857569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:47.865069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-87397ece-febd-4489-8456-6ef2c3b423c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078190 Nov 24 18:48:47.865701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1333/2449] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:47 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:48.882551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:48.883160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:48.889344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:48.889814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:48.890583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:48.891020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:48.948887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:48.956467 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b8446203-c444-45a5-a37d-551301bb9848 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.077596 Nov 24 18:48:48.957030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1334/2450] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:48 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:49.973555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:49.974270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:49.981696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:49.982175 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:49.982946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:49.983459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:50.043477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:50.051070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4b91b1e6-8388-4cdd-878f-375d910e6530 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081178 Nov 24 18:48:50.051634 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1335/2451] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:49 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:51.068668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:51.069341 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:51.075822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:51.076274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:51.077049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:51.077491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:51.136516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:51.144142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2ed2eb58-d285-4cae-aae6-6282da3671d3 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079179 Nov 24 18:48:51.145002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1336/2452] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:51 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:52.161555 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:52.162303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:52.168987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:52.169441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:52.170245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:52.170686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:52.232237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:52.239972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7bd8d931-dbf5-4c53-8698-640c603d7432 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082055 Nov 24 18:48:52.240534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1337/2453] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:52 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:53.256403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:53.257090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:53.263334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:53.263783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:53.264550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:53.264985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:53.323340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:53.330918 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-994e8377-9f81-4025-b3f0-117128f62f8b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078226 Nov 24 18:48:53.331503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1338/2454] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:53 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:54.347799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:54.348612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:54.354816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:54.355274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:54.356051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:54.356490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:54.418028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:54.425940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-36101be2-cfc7-4bdd-882e-a41b47d2cae6 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081727 Nov 24 18:48:54.426577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1339/2455] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:54 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:55.442596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:55.443259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:55.450429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:55.450911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:55.451665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:55.452094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:55.510798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:55.518495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bea1ace6-7790-4cb1-8d5a-69990221b3fc tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079525 Nov 24 18:48:55.519053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1340/2456] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:55 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:56.535064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:56.535734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:56.541972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:56.542428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:56.543197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:56.543635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:56.604177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:56.611818 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78f3daef-ef59-41c1-97a7-8d1790a3c39b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080393 Nov 24 18:48:56.612389 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1341/2457] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:56 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:57.628176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:57.628879 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:57.635821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:57.636280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:57.637053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:57.637493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:57.699352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:57.707209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0385dede-2695-40d9-8370-9ba2b195ad98 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082734 Nov 24 18:48:57.707782 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1342/2458] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:57 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:48:58.724992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:48:58.725720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:48:58.732172 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:58.732622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:58.733399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:48:58.733865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:48:59.044539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:48:59.052456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0adfdd3e-83e6-4946-bd9e-85e766020fc5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.331223 Nov 24 18:48:59.053378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1343/2459] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:48:58 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:00.069745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:00.070551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:00.077132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:00.077542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:00.078208 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:00.078704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:00.137053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:00.144929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2d77b212-07e7-4872-af37-64d4d35edcef tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078826 Nov 24 18:49:00.145489 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1344/2460] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:00 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:01.161694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:01.162410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:01.169401 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:01.169884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:01.182766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:01.182766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:01.229952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:01.237808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8b51e0a2-7e05-44cf-8416-ad6c4b71cd6b tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079839 Nov 24 18:49:01.238374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1345/2461] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:01 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:02.254387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:02.255085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:02.262006 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:02.262459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:02.263230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:02.263669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:02.321460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:02.329689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7e6fff05-f679-44f6-8ce4-51d224d0bfe5 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078970 Nov 24 18:49:02.330284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1346/2462] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:02 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:03.347103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:03.347799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:03.354868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:03.355319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:03.356100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:03.356537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:03.417815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:03.425525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c6259ff-e669-45e8-b296-088e1ee0515a tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082118 Nov 24 18:49:03.426147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1347/2463] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:03 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:04.441995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:04.442695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:04.449571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:04.450050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:04.450826 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:04.451269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:04.508706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:04.517036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-235b71b2-4d39-41e7-a7d9-b57c3ed6e4c1 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.078701 Nov 24 18:49:04.517607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1348/2464] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:04 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:05.534596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:05.535306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:05.542565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:05.543018 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:05.543786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:05.544224 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:05.611757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:05.619648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7694a6d2-b67f-4180-8a86-7900e357dc91 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.088689 Nov 24 18:49:05.620279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1349/2465] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:05 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:06.636743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:06.638492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:06.645086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:06.645655 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:06.646348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:06.646794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:06.712234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:06.720103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8b3daef6-1b51-44b0-b393-92d886de0a85 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.087419 Nov 24 18:49:06.720685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1350/2466] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:06 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:49:07.736561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:07.737352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:07.744138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:07.744601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:07.745474 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:07.745960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:07.810526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:07.818274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0e7ba2e6-8c09-42cf-8c88-d58504519239 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.085587 Nov 24 18:49:07.818843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1351/2467] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:07 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:08.835202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:08.835887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:08.843161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:08.843611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:08.844381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:08.844815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:08.905158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:08.912915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-951b552b-66b3-4037-a0bc-18b6a247c020 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.081792 Nov 24 18:49:08.916502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1352/2468] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:08 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:49:09.930001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:09.930647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:09.936563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:09.937013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:09.937809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:09.938247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:09.997557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:10.005644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-22dc0bac-640d-42df-8ef7-8c20f965d48c tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.079290 Nov 24 18:49:10.006242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1353/2469] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:09 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:11.023368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:11.024030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:11.031132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:11.031592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:11.032377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:11.032817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:11.092685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:11.100256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bafd72da-cd60-4113-8d1b-f0340f0406c0 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.080609 Nov 24 18:49:11.100815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1354/2470] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:11 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:12.116680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:12.117348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:12.124308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:12.124765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:12.125545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:12.126014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:12.186234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:12.195462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ae7cd42-31d8-4cde-abb3-b5a4231e3cb4 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1353 microversion: 2.1 time: 0.082407 Nov 24 18:49:12.196035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1355/2471] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:12 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:13.212197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:13.213537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:13.220315 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:13.220771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:13.221546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:13.222003 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:13.253112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:13.253552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:13.254056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lazy-loading 'fault' on Instance uuid 01eba79d-7c56-4ad4-8a6d-b3084fb1952f {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:49:13.297093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3c2e8e2bca4a38a473ab0e3641354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe321c3b30984971a98e41f672e2c582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:49:13.303639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c1d32008-6ca3-43e4-a738-5b1c2140c583 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 200 len: 1401 microversion: 2.1 time: 0.095199 Nov 24 18:49:13.304195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1356/2472] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:13 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 1401 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:14.326654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:14.328115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] [instance: 01eba79d-7c56-4ad4-8a6d-b3084fb1952f] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:49:14.334249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:14.334710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:14.335481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:14.335913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:14.349441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] HTTP exception thrown: Instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f could not be found. Nov 24 18:49:14.350055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] Returning 404 to user: Instance 01eba79d-7c56-4ad4-8a6d-b3084fb1952f could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:49:14.350878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-210e8bc0-50c5-4db5-a1c8-f0beeabadcc7 tempest-ServerRescueNegativeTestJSON-739513956 tempest-ServerRescueNegativeTestJSON-739513956-project] 10.222.0.53 "GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f" status: 404 len: 111 microversion: 2.1 time: 0.027839 Nov 24 18:49:14.351440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1357/2473] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:49:14 2021] GET /compute/v2.1/servers/01eba79d-7c56-4ad4-8a6d-b3084fb1952f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:49:14.482787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-6af1b561-e563-4167-8a03-298ae070d819 req-17100642-f751-452e-9b4c-67857a3f87d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d89cec0-16f4-478a-b48a-344063683dff", "name": "network-vif-deleted", "tag": "a3f010ff-db6e-4dad-aabe-463f75447b86"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:49:14.484614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:49:14.484614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:49:14.492620 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-6af1b561-e563-4167-8a03-298ae070d819 req-17100642-f751-452e-9b4c-67857a3f87d3 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:49:14.499919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-6af1b561-e563-4167-8a03-298ae070d819 req-17100642-f751-452e-9b4c-67857a3f87d3 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:49:14.512046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-6af1b561-e563-4167-8a03-298ae070d819 req-17100642-f751-452e-9b4c-67857a3f87d3 service nova] Creating event network-vif-deleted:a3f010ff-db6e-4dad-aabe-463f75447b86 for instance 0d89cec0-16f4-478a-b48a-344063683dff on hv-cinder-80403 Nov 24 18:49:14.518627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-6af1b561-e563-4167-8a03-298ae070d819 req-17100642-f751-452e-9b4c-67857a3f87d3 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165824 Nov 24 18:49:14.519469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1358/2474] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:49:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:49:15.135194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:49:15.135469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:49:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:49:17.159304 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:49:17.162266 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:49:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:49:19.488118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e6bacbfa-3c5f-42df-a9e5-20c435bd0d3c tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Action: 'create', calling method: .version_select at 0x7f8ba83c94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-143586377", "metadata": {"Type": "work"}}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:49:20.137182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e6bacbfa-3c5f-42df-a9e5-20c435bd0d3c tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.759881 Nov 24 18:49:20.137825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1359/2475] 10.222.0.53 () {60 vars in 1155 bytes} [Wed Nov 24 18:49:19 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 24 18:49:20.149597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4202e51a-7280-4651-924c-596bfbf85230 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba83f04c0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:20.211037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4202e51a-7280-4651-924c-596bfbf85230 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 352 microversion: 2.1 time: 0.064806 Nov 24 18:49:20.211617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1360/2476] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:20 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:21.223340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-597be3f0-b0c3-4776-a869-92ecc581a720 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba83f0ca0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:21.272442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-597be3f0-b0c3-4776-a869-92ecc581a720 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 352 microversion: 2.1 time: 0.052720 Nov 24 18:49:21.273200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1361/2477] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:21 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:22.291707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1db397c-38e6-4fd0-b47d-bb5048e042d3 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba84b20d0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:22.337436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1db397c-38e6-4fd0-b47d-bb5048e042d3 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 352 microversion: 2.1 time: 0.049716 Nov 24 18:49:22.338237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1362/2478] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:22 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:23.349276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b1f0f3f1-39fc-4970-af19-45d8be53e52c tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba85d6d30>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:23.403693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b1f0f3f1-39fc-4970-af19-45d8be53e52c tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 353 microversion: 2.1 time: 0.058409 Nov 24 18:49:23.410594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1363/2479] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:23 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:23.420681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71b08419-7c7f-4ca7-8284-462edf87ad4b tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba8874280>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:23.463733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71b08419-7c7f-4ca7-8284-462edf87ad4b tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 353 microversion: 2.1 time: 0.050906 Nov 24 18:49:23.464416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1364/2480] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:23 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:49:23.475542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d82895a-7671-4279-bf1a-ca0a32a608d4 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba84b2280>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:23.756084 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d82895a-7671-4279-bf1a-ca0a32a608d4 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 202 len: 0 microversion: 2.1 time: 0.283853 Nov 24 18:49:23.756633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1365/2481] 10.222.0.53 () {58 vars in 1247 bytes} [Wed Nov 24 18:49:23 2021] DELETE /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:49:23.766596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f53c3d00-8505-420f-9787-f89abc06707f tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba85ff550>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:23.811480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f53c3d00-8505-420f-9787-f89abc06707f tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 200 len: 352 microversion: 2.1 time: 0.049618 Nov 24 18:49:23.811480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1366/2482] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:23 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:24.823825 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6ed0b3f2-912c-4404-86d0-fdce3742f649 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Calling method '.version_select at 0x7f8ba83f0160>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:24.851666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-6ed0b3f2-912c-4404-86d0-fdce3742f649 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] HTTP exception thrown: Volume b1127c86-f8c8-412e-ab42-319ad583caf8 could not be found. Nov 24 18:49:24.852252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6ed0b3f2-912c-4404-86d0-fdce3742f649 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] Returning 404 to user: Volume b1127c86-f8c8-412e-ab42-319ad583caf8 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:49:24.853069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6ed0b3f2-912c-4404-86d0-fdce3742f649 tempest-VolumesGetTestJSON-912045149 tempest-VolumesGetTestJSON-912045149-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8" status: 404 len: 109 microversion: 2.1 time: 0.033378 Nov 24 18:49:24.853604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1367/2483] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:24 2021] GET /compute/v2.1/os-volumes/b1127c86-f8c8-412e-ab42-319ad583caf8 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:49:28.573565 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f6ab43f2-0714-4181-a906-d46b8fd6253c tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8bacd179d0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:28.620047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f6ab43f2-0714-4181-a906-d46b8fd6253c tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/2f5a9b56-c1de-4b18-8902-0fac278a3872" status: 200 len: 351 microversion: 2.1 time: 0.050185 Nov 24 18:49:28.620173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1368/2484] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:28 2021] GET /compute/v2.1/os-volumes/2f5a9b56-c1de-4b18-8902-0fac278a3872 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:30.339939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-dc154c2a-bee0-4e94-abdc-e08736a6a72d tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba847ed30>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:30.387276 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-dc154c2a-bee0-4e94-abdc-e08736a6a72d tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/c0d07ef7-ddac-4f58-8f70-55862e913f77" status: 200 len: 351 microversion: 2.1 time: 0.051349 Nov 24 18:49:30.393260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1369/2485] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:30 2021] GET /compute/v2.1/os-volumes/c0d07ef7-ddac-4f58-8f70-55862e913f77 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:37.343249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d469f423-4cd2-4518-98de-fdacbefd54d9 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8372ca0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.390036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d469f423-4cd2-4518-98de-fdacbefd54d9 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/87c1b496-8cf9-49d7-a546-40cd7e615756" status: 200 len: 351 microversion: 2.1 time: 0.050927 Nov 24 18:49:37.390602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1370/2486] 10.222.0.53 () {58 vars in 1244 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes/87c1b496-8cf9-49d7-a546-40cd7e615756 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:49:37.402199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7849ceb5-ca0e-484a-a12a-65366699f7bc tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba847e550>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.481030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7849ceb5-ca0e-484a-a12a-65366699f7bc tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082225 Nov 24 18:49:37.481607 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1371/2487] 10.222.0.53 () {58 vars in 1133 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:37.493412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9e1e175f-406c-474a-b3d8-d24e09d51859 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8584820>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.575633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9e1e175f-406c-474a-b3d8-d24e09d51859 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085859 Nov 24 18:49:37.576284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1372/2488] 10.222.0.53 () {58 vars in 1148 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:37.588294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e2e35983-b762-4f06-96fc-a8b468e8c776 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8693430>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.667338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e2e35983-b762-4f06-96fc-a8b468e8c776 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082460 Nov 24 18:49:37.667915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1373/2489] 10.222.0.53 () {58 vars in 1133 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:37.678409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-811d2c4c-e833-40e5-9648-4e86967555e5 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba88f4af0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.756488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-811d2c4c-e833-40e5-9648-4e86967555e5 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081001 Nov 24 18:49:37.757088 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1374/2490] 10.222.0.53 () {58 vars in 1166 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:37.768946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c6cc386-361f-4ae8-8899-6a4d000e68fd tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8420790>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.846120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c6cc386-361f-4ae8-8899-6a4d000e68fd tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081212 Nov 24 18:49:37.846763 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1375/2491] 10.222.0.53 () {58 vars in 1169 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:49:37.857852 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-edc553e1-71ba-4ba6-aff1-71000bd8b24a tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8470310>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:37.938124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-edc553e1-71ba-4ba6-aff1-71000bd8b24a tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083439 Nov 24 18:49:37.942860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1376/2492] 10.222.0.53 () {58 vars in 1154 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:49:37.951824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-16eda6f1-e0a9-4456-bbc0-6cace49d8f2f tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba847eaf0>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:38.035534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-16eda6f1-e0a9-4456-bbc0-6cace49d8f2f tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086484 Nov 24 18:49:38.036121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1377/2493] 10.222.0.53 () {58 vars in 1187 bytes} [Wed Nov 24 18:49:37 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:49:38.046866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-26f07987-b04e-4be2-a4a2-b70549b323b0 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] Calling method '.version_select at 0x7f8ba8584940>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:49:38.126700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-26f07987-b04e-4be2-a4a2-b70549b323b0 tempest-VolumesTestJSON-878405596 tempest-VolumesTestJSON-878405596-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082043 Nov 24 18:49:38.126700 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1378/2494] 10.222.0.53 () {58 vars in 1154 bytes} [Wed Nov 24 18:49:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:12.052958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-261583861", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "6c97b729-0821-4214-bdf8-d2fb5238bb79"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:12.312259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] validate_networks() for [('6c97b729-0821-4214-bdf8-d2fb5238bb79', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:50:12.902523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:50:12.902824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:50:12.903419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:50:12.903699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:50:12.904104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:50:12.913905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:12.914446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:12.915255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:12.915669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:12.932970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Getting quotas for project d363cce0bea3446c89697a2c34760aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:50:12.936814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Getting quotas for user 9946a4c083104c8790c3fdfb8cb339e9 and project d363cce0bea3446c89697a2c34760aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:50:12.948142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:50:12.950746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:50:13.077157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [0722fd06-6219-4361-8255-45716c3bc26c] AMQP server on 10.222.0.53:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:50:14.095395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [0722fd06-6219-4361-8255-45716c3bc26c] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 49372. Nov 24 18:50:14.102703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f11ac0e5-564b-434e-add8-b9dcfa19acc1 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054716 Nov 24 18:50:14.108403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1379/2495] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:50:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:50:14.117053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8d635578-d550-4787-ab1d-7cf1849653a9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:14.118351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8d635578-d550-4787-ab1d-7cf1849653a9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:14.174087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8d635578-d550-4787-ab1d-7cf1849653a9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:14.181994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8d635578-d550-4787-ab1d-7cf1849653a9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1213 microversion: 2.1 time: 0.071300 Nov 24 18:50:14.182753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1380/2496] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:14 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:15.199245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0f7e47ab-08f9-4d47-9324-e5a13979f5af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:15.199922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0f7e47ab-08f9-4d47-9324-e5a13979f5af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:15.256779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0f7e47ab-08f9-4d47-9324-e5a13979f5af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:15.269577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0f7e47ab-08f9-4d47-9324-e5a13979f5af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1213 microversion: 2.1 time: 0.073877 Nov 24 18:50:15.270540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1381/2497] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:15 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:16.286736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3ec626d1-ab5b-47fc-8488-3eb7b43b0776 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:16.288359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3ec626d1-ab5b-47fc-8488-3eb7b43b0776 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:16.348177 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3ec626d1-ab5b-47fc-8488-3eb7b43b0776 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:16.355967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3ec626d1-ab5b-47fc-8488-3eb7b43b0776 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1213 microversion: 2.1 time: 0.072804 Nov 24 18:50:16.357941 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1382/2498] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:16 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:17.376645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8ace7f14-bb37-4a62-a4aa-ed34a946c9cd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:17.377986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8ace7f14-bb37-4a62-a4aa-ed34a946c9cd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:17.436748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8ace7f14-bb37-4a62-a4aa-ed34a946c9cd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:17.444745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8ace7f14-bb37-4a62-a4aa-ed34a946c9cd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1213 microversion: 2.1 time: 0.073952 Nov 24 18:50:17.456130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1383/2499] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:17 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:18.465314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:18.467578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:18.477827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:18.483971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:18.483971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:18.483971 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:18.569008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:18.574412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8cf2e125-ea76-4889-9ce4-050cc10e6bf2 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1217 microversion: 2.1 time: 0.113526 Nov 24 18:50:18.575007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1384/2500] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:18 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:19.591721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:19.593077 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:19.600412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:19.601022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:19.601856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:19.602498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:19.669900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:19.677189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a783a29-0d93-409f-96d2-6e869035921b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1217 microversion: 2.1 time: 0.089395 Nov 24 18:50:19.678627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1385/2501] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:19 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:20.695742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:20.696359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:20.703736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:20.704188 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:20.704978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:20.705415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:20.767660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:20.781409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3483e5b1-d485-4d46-af30-2c5023ed2624 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1265 microversion: 2.1 time: 0.089452 Nov 24 18:50:20.782299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1386/2502] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:20 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:21.799754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:21.804949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:21.820652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:21.821563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:21.824189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:21.824305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:21.929198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:21.939096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fa2e38df-43bb-4917-a7d2-6f90ec57443b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1265 microversion: 2.1 time: 0.143045 Nov 24 18:50:21.945869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1387/2503] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:21 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:22.965853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:22.966612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:22.979944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:22.980760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:22.981787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:22.982663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:23.067480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:23.075314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e101407a-378f-4473-842e-d309fbe11062 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1265 microversion: 2.1 time: 0.118621 Nov 24 18:50:23.076221 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1388/2504] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:22 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:24.092064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:24.092681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:24.104729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:24.105182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:24.106078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:24.106683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:24.184780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:24.192697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ac47c517-0fa4-464f-b42b-f5c5607eb829 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1271 microversion: 2.1 time: 0.104101 Nov 24 18:50:24.194466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1389/2505] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:24 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:25.211424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:25.212032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:25.223100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:25.223556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:25.224343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:25.225381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:25.548686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:25.562081 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e0e8a9e2-2e87-4e17-86ab-b6e64f47f999 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.355444 Nov 24 18:50:25.572396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1390/2506] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:25 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:26.086055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-0c19242b-5209-4369-8d47-1f4698449c3b req-493538e7-d1a9-4b67-9ba3-c043711ce857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a49bc4-7f7f-4335-87c8-347b53eccff4", "tag": "88783928-72f6-4cd7-93b6-9c8d8eaa5b44"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:26.087670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:50:26.087670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:50:26.096685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-0c19242b-5209-4369-8d47-1f4698449c3b req-493538e7-d1a9-4b67-9ba3-c043711ce857 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:26.097349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-0c19242b-5209-4369-8d47-1f4698449c3b req-493538e7-d1a9-4b67-9ba3-c043711ce857 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:26.109615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-0c19242b-5209-4369-8d47-1f4698449c3b req-493538e7-d1a9-4b67-9ba3-c043711ce857 service nova] Creating event network-changed:88783928-72f6-4cd7-93b6-9c8d8eaa5b44 for instance 90a49bc4-7f7f-4335-87c8-347b53eccff4 on hv-cinder-80403 Nov 24 18:50:26.115955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-0c19242b-5209-4369-8d47-1f4698449c3b req-493538e7-d1a9-4b67-9ba3-c043711ce857 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033042 Nov 24 18:50:26.116837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1391/2507] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:50:26.579862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:26.581303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:26.588624 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:26.589149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:26.590180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:26.590719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:26.849510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:26.859609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-95c84c18-cc5f-4571-b659-e3f9327bb0ed tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.284611 Nov 24 18:50:26.860278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1392/2508] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:26 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:27.876812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:27.877469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:27.889117 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:27.893356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:27.894737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:27.897222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:28.079056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:28.088707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6fd252bf-94d5-491a-a319-b19e38cab99c tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.215520 Nov 24 18:50:28.089547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1393/2509] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:27 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:29.109947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:29.111302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:29.118404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:29.123659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:29.123659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:29.123659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:29.355151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:29.365197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f1c52066-ff3a-4bd0-9a94-c0382e929185 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.261889 Nov 24 18:50:29.376751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1394/2510] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:29 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:29.653645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:50:29.653645 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:50:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:50:30.383429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:30.384049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:30.407331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:30.408138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:30.409586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:30.410430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:30.588893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:30.596911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b593720a-5b1d-4f6a-b09d-c92cca1224fe tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.217885 Nov 24 18:50:30.597855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1395/2511] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:30 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:31.615189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:31.617830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:31.624797 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:31.625330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:31.626215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:31.626867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:31.830245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:31.849815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4bb88cf8-ad22-4f1d-84a9-ab2ad403e489 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.238212 Nov 24 18:50:31.851978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1396/2512] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:31 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:32.866788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:32.868149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:32.875268 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:32.875726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:32.876617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:32.876937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:33.042591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:33.051877 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-40885a37-c902-4dae-ac17-0a93a34aa521 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.188637 Nov 24 18:50:33.052570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1397/2513] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:32 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:34.071898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:34.072681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:34.080053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:34.080911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:34.083169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:34.083169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:34.238359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:34.465039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0a369f6a-8df1-4289-9a01-b26665d80b83 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.179530 Nov 24 18:50:34.465039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1398/2514] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:34 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:35.268671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:35.269337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:35.276988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:35.277577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:35.278570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:35.279154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:35.431397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:35.439030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8a154d52-5f4c-4f19-837a-5ff42d7dc871 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.176326 Nov 24 18:50:35.450648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1399/2515] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:35 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:36.487227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-69acab58-4af9-47d1-ae18-4087fb2902a8 req-c7dc717a-d331-4c29-8151-a744733af573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a49bc4-7f7f-4335-87c8-347b53eccff4", "name": "network-vif-plugged", "status": "completed", "tag": "88783928-72f6-4cd7-93b6-9c8d8eaa5b44"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:36.488771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:50:36.488771 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:50:36.498820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-69acab58-4af9-47d1-ae18-4087fb2902a8 req-c7dc717a-d331-4c29-8151-a744733af573 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:36.499529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-69acab58-4af9-47d1-ae18-4087fb2902a8 req-c7dc717a-d331-4c29-8151-a744733af573 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:36.515708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-69acab58-4af9-47d1-ae18-4087fb2902a8 req-c7dc717a-d331-4c29-8151-a744733af573 service nova] Creating event network-vif-plugged:88783928-72f6-4cd7-93b6-9c8d8eaa5b44 for instance 90a49bc4-7f7f-4335-87c8-347b53eccff4 on hv-cinder-80403 Nov 24 18:50:36.528037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-69acab58-4af9-47d1-ae18-4087fb2902a8 req-c7dc717a-d331-4c29-8151-a744733af573 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249506 Nov 24 18:50:36.528665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1400/2516] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:50:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:50:36.536398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:36.537396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:36.545258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:36.545958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:36.547046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:36.547639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:37.023258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:37.031874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0d01fb3f-f716-4e10-a5f6-a7c7555f300b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.501987 Nov 24 18:50:37.032851 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1401/2517] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:36 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:38.050443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:38.051142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:38.058285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:38.058745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:38.059520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:38.059957 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:38.194029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:38.202509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f39ab000-c758-4e60-8701-877398ead0dd tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1313 microversion: 2.1 time: 0.155734 Nov 24 18:50:38.203085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1402/2518] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:38 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:39.219861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:39.220483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:39.227736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:39.228180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:39.228947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:39.229379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:39.364060 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:39.371338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0df5a3e2-161b-44f7-98db-ee3bc83b41af tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1498 microversion: 2.1 time: 0.155628 Nov 24 18:50:39.371914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1403/2519] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:39 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:39.376086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'create', calling method: .version_select at 0x7f8ba87e2280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2035171140"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:39.389683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for project b05fb7f9c87945209429bb1cada0530c. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:50:39.393791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for user a20770fc7551413f8981cb075e6ea13c and project b05fb7f9c87945209429bb1cada0530c. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:50:39.638415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for project b05fb7f9c87945209429bb1cada0530c. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:50:39.642424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for user a20770fc7551413f8981cb075e6ea13c and project b05fb7f9c87945209429bb1cada0530c. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:50:39.656107 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f9a04e3d-8b1a-44e5-ba3f-e228de02a198 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.283249 Nov 24 18:50:39.656722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1404/2520] 10.222.0.53 () {60 vars in 1157 bytes} [Wed Nov 24 18:50:39 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:39.708414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1734739273", "imageRef": "b9f0194f-7557-4e81-9453-f7a6e1e404f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2035171140", "networks": [{"uuid": "d0924b82-19fc-44d6-b49d-59748f16878a"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:39.760597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] validate_networks() for [('d0924b82-19fc-44d6-b49d-59748f16878a', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:50:40.153591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:50:40.156919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:50:40.156919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:50:40.156919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:50:40.156919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:50:40.164588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.165120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.165958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.166390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.184064 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for project b05fb7f9c87945209429bb1cada0530c. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:50:40.188290 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Getting quotas for user a20770fc7551413f8981cb075e6ea13c and project b05fb7f9c87945209429bb1cada0530c. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:50:40.205263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:50:40.205263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9f0194f-7557-4e81-9453-f7a6e1e404f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:50:40.300051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c387e160-f8f9-4309-abc1-36ff74496a98 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595767 Nov 24 18:50:40.300947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1405/2521] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:50:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:50:40.305158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:40.305659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:40.312085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.312557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.316563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.316563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.342183 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:50:40.632237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d1e25eed-9786-4bda-8438-54b4614fb476 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "DELETE /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 204 len: 0 microversion: 2.1 time: 0.328579 Nov 24 18:50:40.632810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1406/2522] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:50:40 2021] DELETE /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:50:40.638306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23a9263a-94b1-4b39-a577-50a59c594186 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:40.639186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23a9263a-94b1-4b39-a577-50a59c594186 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:40.701863 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-23a9263a-94b1-4b39-a577-50a59c594186 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:40.708571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23a9263a-94b1-4b39-a577-50a59c594186 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1259 microversion: 2.1 time: 0.074646 Nov 24 18:50:40.709166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1407/2523] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:40 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:40.715495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:40.716125 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:40.722549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.723073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.723947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:40.724457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:40.873883 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:40.881650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-65c67900-03d0-47a1-98c3-f6dc021d5276 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1504 microversion: 2.1 time: 0.170797 Nov 24 18:50:40.885145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1408/2524] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:40 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:41.725547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:41.726238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:41.732078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:41.732529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:41.733297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:41.733791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:41.799504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:41.803093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d155424f-7b84-4a10-a34b-122f76c5d48d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1263 microversion: 2.1 time: 0.081323 Nov 24 18:50:41.803695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1409/2525] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:41 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:41.898230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:41.898846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:41.906178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:41.906627 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:41.907441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:41.908025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:42.050936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:42.057300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-855376d4-b7cb-481d-83c2-161d871e03b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1504 microversion: 2.1 time: 0.162657 Nov 24 18:50:42.057890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1410/2526] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:41 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:42.734591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-9b98ce0d-b8ec-4034-a0dc-16272f356532 req-cd30fe8f-ad08-46b2-9dae-23625040ade5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a49bc4-7f7f-4335-87c8-347b53eccff4", "name": "network-vif-deleted", "tag": "88783928-72f6-4cd7-93b6-9c8d8eaa5b44"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:42.736229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:50:42.736229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:50:42.743631 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9b98ce0d-b8ec-4034-a0dc-16272f356532 req-cd30fe8f-ad08-46b2-9dae-23625040ade5 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:42.744073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9b98ce0d-b8ec-4034-a0dc-16272f356532 req-cd30fe8f-ad08-46b2-9dae-23625040ade5 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:42.754398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-9b98ce0d-b8ec-4034-a0dc-16272f356532 req-cd30fe8f-ad08-46b2-9dae-23625040ade5 service nova] Creating event network-vif-deleted:88783928-72f6-4cd7-93b6-9c8d8eaa5b44 for instance 90a49bc4-7f7f-4335-87c8-347b53eccff4 on hv-cinder-80403 Nov 24 18:50:42.759197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-9b98ce0d-b8ec-4034-a0dc-16272f356532 req-cd30fe8f-ad08-46b2-9dae-23625040ade5 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028151 Nov 24 18:50:42.759783 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1411/2527] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:50:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:50:42.820433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:42.821219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:42.827580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:42.828044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:42.828808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:42.829306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:42.891553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:42.900440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e87e9d00-093c-4498-a452-9a293a341b01 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1329 microversion: 2.1 time: 0.083896 Nov 24 18:50:42.901015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1412/2528] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:42 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:43.074751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:43.075701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:43.082899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:43.083342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:43.084120 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:43.084549 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:43.147211 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:43.155169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-09bcbfac-3710-4bf4-bb2c-a6c0d90e5ce7 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1462 microversion: 2.1 time: 0.084358 Nov 24 18:50:43.155741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1413/2529] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:43 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:43.917609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:43.918233 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:43.924394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:43.924837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:43.925849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:43.926280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:43.987146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:43.995030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e0efddb1-2088-45a5-bf57-0f56ae44b901 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1329 microversion: 2.1 time: 0.081273 Nov 24 18:50:43.995585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1414/2530] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:43 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1329 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:44.173497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:44.174050 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:44.180965 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:44.181915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:44.182970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:44.183412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:44.242118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:44.250754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8890db16-4964-42cb-bd4e-f19a6705c191 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1462 microversion: 2.1 time: 0.081023 Nov 24 18:50:44.251330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1415/2531] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:44 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:45.011498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:45.012152 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:45.018185 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:45.018628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:45.019385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:45.019812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:45.079048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:45.087016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a30b2a71-f2f7-4375-ac44-ec500b88cded tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1329 microversion: 2.1 time: 0.079100 Nov 24 18:50:45.087665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1416/2532] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:45 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1329 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:45.267403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:45.267952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:45.275070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:45.275525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:45.276300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:45.276765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:45.338022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:45.345255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4222c5b4-c5d0-4131-a363-363d2df6b551 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1462 microversion: 2.1 time: 0.081818 Nov 24 18:50:45.345837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1417/2533] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:45 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:46.103886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:46.105935 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:46.111606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:46.112056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:46.112848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:46.113282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:46.172874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:46.180109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-19a95b8a-041a-4676-b317-1d69c24f70bd tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1329 microversion: 2.1 time: 0.080115 Nov 24 18:50:46.180676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1418/2534] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:46 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1329 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:46.364265 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:46.364791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:46.371056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:46.371502 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:46.372271 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:46.372712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:46.435824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:46.443063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bc47d8ed-8b5c-4ce5-999e-d8a163d14678 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1462 microversion: 2.1 time: 0.082535 Nov 24 18:50:46.443649 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1419/2535] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:46 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:47.196504 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:47.197192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:47.212615 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:47.213245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:47.214419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:47.215110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:47.480023 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:47.496680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2cb9e9cd-95c2-435e-8ec7-a0e1340b455a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.303774 Nov 24 18:50:47.497516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1420/2536] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:47 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:47.511294 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:47.512067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:47.523250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:47.524512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:47.525557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:47.526612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:47.593509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:47.605633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:47.606390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:47.661423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:47.670123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9dc873af-70e3-4347-9f50-3146c58a12f4 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.171029 Nov 24 18:50:47.670936 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1421/2537] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:47 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:48.513595 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:48.514259 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:48.520966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:48.521420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:48.522240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:48.522875 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:48.675790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:48.684383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a577e519-c9b1-46e4-a4d1-0ea962d832e2 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.174367 Nov 24 18:50:48.685273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1422/2538] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:48 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:48.700130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:48.701022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:48.707576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:48.708021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:48.708803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:48.709219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:48.739576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:48.740012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:48.740451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:48.782677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:48.790477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-aec9a101-2c5f-49be-9baa-32d8ecc56902 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.094503 Nov 24 18:50:48.791283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1423/2539] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:48 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:49.701714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:49.702378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:49.708522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:49.708963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:49.709715 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:49.710236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:49.854989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:49.862372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-659eca8f-0f3f-4d63-8024-b4dd5961d0ec tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.165016 Nov 24 18:50:49.862948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1424/2540] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:49 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:49.867174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:49.867816 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:49.873855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:49.874304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:49.875074 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:49.875526 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:49.910534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:49.911165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:49.911921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:49.958256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:49.974068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6cb638cb-e184-4405-9baa-280f3c7382f6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.104450 Nov 24 18:50:49.974068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1425/2541] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:49 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:50.880958 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:50.881628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:50.888671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:50.889130 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:50.889943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:50.890692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:51.057121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:51.064861 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-20057dd3-ef01-42d9-a099-dd38c6074bad tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.188078 Nov 24 18:50:51.065964 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1426/2542] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:50 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:51.070414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:51.086665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:51.098170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:51.099147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:51.099991 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:51.100435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:51.135908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:51.136279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:51.136734 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:51.181647 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:51.189913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-096216ab-695e-406a-8ed9-e822c13860e9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.122696 Nov 24 18:50:51.190732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1427/2543] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:51 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:52.084560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:52.085147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:52.092136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:52.092594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:52.093382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:52.093924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:52.279680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:52.287567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-31a26173-7b2f-4f18-ae78-ca1c7d8c471b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.206556 Nov 24 18:50:52.288263 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1428/2544] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:52 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:52.292767 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:52.294049 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:52.299919 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:52.300365 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:52.301132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:52.301566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:52.333269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:52.333657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:52.334129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:52.405990 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:52.413629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ed6ae0f9-7ef2-4750-8bc1-87043850124d tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.124339 Nov 24 18:50:52.414237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1429/2545] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:52 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:53.128138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:53.128644 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:53.134923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.135375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.136158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.137342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.151237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] HTTP exception thrown: Instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 could not be found. Nov 24 18:50:53.151846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Returning 404 to user: Instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:50:53.152889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e5355432-0961-4e98-8145-4938669ca422 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 404 len: 111 microversion: 2.1 time: 0.028222 Nov 24 18:50:53.153299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1430/2546] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:50:53 2021] DELETE /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:50:53.164925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:53.164925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] [instance: 7a308b4d-3cdc-4213-82f2-e95a18edd2e0] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:53.174227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.174227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.174227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.174227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.192815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] HTTP exception thrown: Instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 could not be found. Nov 24 18:50:53.193544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] Returning 404 to user: Instance 7a308b4d-3cdc-4213-82f2-e95a18edd2e0 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:50:53.194466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9894095f-7af6-4aec-a61b-dce52317c3a0 tempest-AttachVolumeTestJSON-1974920716 tempest-AttachVolumeTestJSON-1974920716-project] 10.222.0.53 "GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0" status: 404 len: 111 microversion: 2.1 time: 0.036916 Nov 24 18:50:53.195373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1431/2547] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:53 2021] GET /compute/v2.1/servers/7a308b4d-3cdc-4213-82f2-e95a18edd2e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:50:53.304618 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:53.305633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:53.313307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.314126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.315261 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.316273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.487528 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:53.495447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9534b662-87ad-406d-8975-c7e05f6d6945 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.194949 Nov 24 18:50:53.499414 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1432/2548] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:53 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:53.514630 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:53.515527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:53.522731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.523364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.524358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.524789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.581195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:53.582057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:53.582666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:53.626078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:53.633886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-437081a0-128c-46ce-a22a-f04018da062b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.124088 Nov 24 18:50:53.634703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1433/2549] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:53 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:54.516024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:54.517977 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:54.528914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:54.536709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:54.537751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:54.538387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:54.754415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:54.783437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a067ea35-3ab6-4fc0-9adc-42b53f8dcac7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.271558 Nov 24 18:50:54.784098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1434/2550] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:54 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:54.794986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:54.795854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:54.802656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:54.803105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:54.803987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:54.804417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:54.849823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:54.850513 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:54.850966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:54.905164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:54.923458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4a8a7ea7-68d6-4cd1-af0a-537d2e798604 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.137988 Nov 24 18:50:54.925200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1435/2551] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:54 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:55.801798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:55.802533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:55.826411 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:55.827592 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:55.828597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:55.829195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:56.094706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:56.103857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14ea2eaf-bcbe-43aa-a865-92fa77cd1097 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.306072 Nov 24 18:50:56.104793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1436/2552] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:55 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:56.127105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:56.127725 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:56.153464 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:56.153948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:56.154735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:56.155169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:56.226757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:56.227228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:56.227679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:56.297160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:56.312507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-60f1fa22-03ec-4daa-99ee-f7a2b88acfd6 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.193977 Nov 24 18:50:56.313291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1437/2553] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:56 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:57.125716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:57.126694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:57.140795 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:57.144150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:57.144150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:57.144150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:57.361656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:57.369728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-abfa5b66-dfba-4713-aaa1-fb526a61afdc tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.249169 Nov 24 18:50:57.382150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1438/2554] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:57 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:57.398967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:57.405998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:57.422025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:57.422680 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:57.424735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:57.427232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:57.494764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:57.497717 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:57.499915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lazy-loading 'fault' on Instance uuid 90a49bc4-7f7f-4335-87c8-347b53eccff4 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:50:57.546154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:57.562503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-14e96e5a-6ebe-4a18-82a2-027c3d330a67 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 200 len: 1303 microversion: 2.1 time: 0.175262 Nov 24 18:50:57.563116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1439/2555] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:57 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:50:58.391240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:58.392898 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:58.399558 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:58.400004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:58.400793 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:58.401226 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:58.707912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:50:58.715925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-04be6d7a-113f-41f8-9351-4a3b04576405 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.328907 Nov 24 18:50:58.716451 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1440/2556] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:58 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:50:58.721195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:58.725998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: 90a49bc4-7f7f-4335-87c8-347b53eccff4] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:58.733245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:58.733701 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:58.734597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:58.734967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:58.751324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] HTTP exception thrown: Instance 90a49bc4-7f7f-4335-87c8-347b53eccff4 could not be found. Nov 24 18:50:58.751324 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Returning 404 to user: Instance 90a49bc4-7f7f-4335-87c8-347b53eccff4 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:50:58.751609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b4ceebad-e8d7-4e9c-9959-413a20aa59df tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4" status: 404 len: 111 microversion: 2.1 time: 0.034253 Nov 24 18:50:58.752207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1441/2557] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:58 2021] GET /compute/v2.1/servers/90a49bc4-7f7f-4335-87c8-347b53eccff4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:50:58.855913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-604218803", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452", "networks": [{"uuid": "6c97b729-0821-4214-bdf8-d2fb5238bb79"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:58.914779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] validate_networks() for [('6c97b729-0821-4214-bdf8-d2fb5238bb79', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:50:59.499566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:50:59.500131 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:50:59.500442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:50:59.500846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:50:59.501253 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:50:59.510611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:59.510999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:59.512288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:59.512764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:59.532724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Getting quotas for project d363cce0bea3446c89697a2c34760aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:50:59.536705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Getting quotas for user 9946a4c083104c8790c3fdfb8cb339e9 and project d363cce0bea3446c89697a2c34760aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:50:59.548694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:50:59.551069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:50:59.671551 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fcf81e10-5330-48f0-a160-ed79b54e0a86 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819745 Nov 24 18:50:59.677523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1442/2558] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:50:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:50:59.880601 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-bf6c7525-329b-4653-ac4c-947d26252518 req-c6a38070-358f-4d6a-a5c6-02a36695c7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:50:59.882899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:50:59.882899 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:50:59.903754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-bf6c7525-329b-4653-ac4c-947d26252518 req-c6a38070-358f-4d6a-a5c6-02a36695c7c4 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:50:59.904830 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-bf6c7525-329b-4653-ac4c-947d26252518 req-c6a38070-358f-4d6a-a5c6-02a36695c7c4 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:50:59.927520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-bf6c7525-329b-4653-ac4c-947d26252518 req-c6a38070-358f-4d6a-a5c6-02a36695c7c4 service nova] Creating event network-changed:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:50:59.932415 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-bf6c7525-329b-4653-ac4c-947d26252518 req-c6a38070-358f-4d6a-a5c6-02a36695c7c4 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253519 Nov 24 18:50:59.933097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1443/2559] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:50:59.938839 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-48d9192d-5e21-4ef5-9ab0-ab81ce8cc0ee tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:50:59.939522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-48d9192d-5e21-4ef5-9ab0-ab81ce8cc0ee tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:50:59.999484 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-48d9192d-5e21-4ef5-9ab0-ab81ce8cc0ee tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:00.006317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-48d9192d-5e21-4ef5-9ab0-ab81ce8cc0ee tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1213 microversion: 2.1 time: 0.071111 Nov 24 18:51:00.007070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1444/2560] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:50:59 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:00.021447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:00.022058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:00.028705 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:00.029561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:00.030563 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:00.031010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:00.309748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:00.317274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b602c67f-0842-47ea-a8a5-8de9ee9369da tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.299382 Nov 24 18:51:00.320794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1445/2561] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:00 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:01.024402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:01.025118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:01.033159 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:01.033748 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:01.034876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:01.035128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:01.125845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:01.132412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2702b309-d030-4f6d-9db4-205eb84787a3 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1217 microversion: 2.1 time: 0.111689 Nov 24 18:51:01.133704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1446/2562] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:01 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:01.333886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:01.336458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:01.341539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:01.342040 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:01.342814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:01.343252 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:01.492670 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:01.501878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cbcdd36f-d2d1-40bb-bc99-0212d517f4be tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.171467 Nov 24 18:51:01.502778 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1447/2563] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:01 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:02.155729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:02.156410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:02.163980 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:02.165011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:02.166044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:02.167157 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:02.247569 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:02.257321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-878b7e16-e942-4c3f-9efd-df561d943963 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1283 microversion: 2.1 time: 0.110466 Nov 24 18:51:02.266057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1448/2564] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:02 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:02.518285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:02.525533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:02.525533 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:02.525832 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:02.526433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:02.526906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:02.796335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:02.804955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6f37b538-2f44-408f-8368-b5d9bfcc918c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.290855 Nov 24 18:51:02.806109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1449/2565] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:02 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:03.277169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:03.278010 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:03.285497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:03.285497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:03.286352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:03.286789 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:03.574873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:03.583706 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-712df025-9d17-402f-a534-6b884454e7ec tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.310056 Nov 24 18:51:03.584282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1450/2566] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:03 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:03.823026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:03.823687 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:03.829895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:03.830351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:03.831143 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:03.831540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:04.069622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:04.076929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4e1cd392-7f52-48d3-8073-b528c43045c4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.257686 Nov 24 18:51:04.082076 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1451/2567] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:03 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:04.283868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-738a9334-3bfa-4c25-b19c-89f853f32779 req-fbc4323a-95b2-4423-b95c-f070d18f6018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca40e7b2-fc35-406d-b591-e7e959805790", "tag": "d23b38c6-97c2-4c11-b75d-6bd6879bb74d"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:04.286948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:04.286948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:04.296007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-738a9334-3bfa-4c25-b19c-89f853f32779 req-fbc4323a-95b2-4423-b95c-f070d18f6018 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:04.296694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-738a9334-3bfa-4c25-b19c-89f853f32779 req-fbc4323a-95b2-4423-b95c-f070d18f6018 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:04.309228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-738a9334-3bfa-4c25-b19c-89f853f32779 req-fbc4323a-95b2-4423-b95c-f070d18f6018 service nova] Creating event network-changed:d23b38c6-97c2-4c11-b75d-6bd6879bb74d for instance ca40e7b2-fc35-406d-b591-e7e959805790 on hv-cinder-80403 Nov 24 18:51:04.314594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-738a9334-3bfa-4c25-b19c-89f853f32779 req-fbc4323a-95b2-4423-b95c-f070d18f6018 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 Nov 24 18:51:04.315244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1452/2568] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:51:04.602061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:04.603122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:04.611007 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:04.611887 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:04.612967 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:04.613612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:04.868485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:04.879073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8e388cb8-214c-4883-97e6-5dcb95a63466 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.280448 Nov 24 18:51:04.880238 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1453/2569] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:04 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:04.945501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-40c8ff82-d064-4688-8354-b8a6a6e6c2fa req-1bab1327-0363-4f0b-8fa8-33111f554135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "name": "network-vif-plugged", "status": "completed", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:04.947044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:04.947044 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:04.954760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-40c8ff82-d064-4688-8354-b8a6a6e6c2fa req-1bab1327-0363-4f0b-8fa8-33111f554135 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:04.955397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-40c8ff82-d064-4688-8354-b8a6a6e6c2fa req-1bab1327-0363-4f0b-8fa8-33111f554135 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:04.969149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-40c8ff82-d064-4688-8354-b8a6a6e6c2fa req-1bab1327-0363-4f0b-8fa8-33111f554135 service nova] Creating event network-vif-plugged:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:51:04.975063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-40c8ff82-d064-4688-8354-b8a6a6e6c2fa req-1bab1327-0363-4f0b-8fa8-33111f554135 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033042 Nov 24 18:51:04.975869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1454/2570] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:51:05.097219 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:05.098196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:05.110584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:05.121951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:05.122796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:05.123873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:05.395456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:05.405173 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bd5c9e89-bdcd-4c70-a296-88a54184b522 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.313982 Nov 24 18:51:05.410821 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1455/2571] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:05 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:05.898433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:05.899372 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:05.908154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:05.908900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:05.910119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:05.910858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:06.072435 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:06.080481 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c315c594-d99c-4994-8c17-eebbc81eb417 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.187590 Nov 24 18:51:06.087020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1456/2572] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:05 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:06.423375 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:06.424032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:06.430407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:06.430855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:06.431757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:06.432080 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:06.577382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:06.584806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3a628040-39d7-4993-99f0-10e4bd508d7b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1359 microversion: 2.1 time: 0.165152 Nov 24 18:51:06.585370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1457/2573] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:06 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:07.098322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:07.099106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:07.110769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.110769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.110769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.110769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.246532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:07.254275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c8cd65c3-858b-4514-a652-8ed5da811564 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.159687 Nov 24 18:51:07.254944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1458/2574] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:07 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:07.601956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:07.602637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:07.609046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.609439 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.610246 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.610686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.751500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:07.761544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-75061ab7-8a2a-47d2-b28a-06af1a454b48 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1550 microversion: 2.1 time: 0.160651 Nov 24 18:51:07.761544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1459/2575] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:07 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:07.775297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:07.775923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:07.782509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.782963 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.783799 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.784236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.921278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:07.929256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f2da9f54-8c33-4187-9fe5-9d1b05937917 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1550 microversion: 2.1 time: 0.157035 Nov 24 18:51:07.931546 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1460/2576] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:07 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:07.947661 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:07.951914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:07.951914 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:07.953058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:07.953834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Searching by: {'deleted': False, 'project_id': 'b05fb7f9c87945209429bb1cada0530c'} {{(pid=116730) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 24 18:51:07.960317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.960932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:07.961902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:07.962610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:08.059353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.multi_cell_list [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116730) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 24 18:51:08.156709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c936ef6f-f6d9-4f14-9df7-f14fd9910510 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212451 Nov 24 18:51:08.157465 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1461/2577] 10.222.0.53 () {58 vars in 1124 bytes} [Wed Nov 24 18:51:07 2021] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:51:08.167134 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:08.167894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:08.177516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:08.177516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:08.177516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:08.177516 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:08.343289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:08.350757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4c4d0138-7b6f-4740-a32e-43bc77147e41 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1550 microversion: 2.1 time: 0.187178 Nov 24 18:51:08.362741 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1462/2578] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:08 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:08.368386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:08.368386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:08.375116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:08.376008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:08.376404 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:08.376840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:08.523471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:08.531868 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7d24c552-1cea-48d7-a82a-402d447fb9d0 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.167998 Nov 24 18:51:08.532491 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1463/2579] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:08 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:09.549359 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:09.550012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:09.556403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:09.556811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:09.557611 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:09.558146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:09.695013 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:09.703222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e47663a2-d163-4b26-bd36-15f81e2fda15 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.157538 Nov 24 18:51:09.703823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1464/2580] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:09 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:10.287560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4cf377-9152-4cce-a97c-d36c7198aa27"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:10.288619 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:10.294585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:10.295054 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:10.295846 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:10.296284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:11.155765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fadb8a9a-e31a-4dbf-a4c6-9b9b44177fa9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871825 Nov 24 18:51:11.156420 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1465/2581] 10.222.0.53 () {60 vars in 1322 bytes} [Wed Nov 24 18:51:10 2021] POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:51:11.162684 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:11.163384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:11.169824 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:11.170212 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:11.170987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:11.171436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:11.318841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:11.326277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-51553a80-e3a5-40af-aadc-fda92f86de18 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.168787 Nov 24 18:51:11.328070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1466/2582] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:11 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:11.331743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-9fe27cf5-9f92-45e3-91e5-a3a84f24da47 req-607fc3b7-2d14-4aec-b31d-e6b3a2a05c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca40e7b2-fc35-406d-b591-e7e959805790", "name": "network-vif-plugged", "status": "completed", "tag": "d23b38c6-97c2-4c11-b75d-6bd6879bb74d"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:11.333312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:11.333312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:11.340417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9fe27cf5-9f92-45e3-91e5-a3a84f24da47 req-607fc3b7-2d14-4aec-b31d-e6b3a2a05c33 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:11.340865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-9fe27cf5-9f92-45e3-91e5-a3a84f24da47 req-607fc3b7-2d14-4aec-b31d-e6b3a2a05c33 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:11.351416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-9fe27cf5-9f92-45e3-91e5-a3a84f24da47 req-607fc3b7-2d14-4aec-b31d-e6b3a2a05c33 service nova] Creating event network-vif-plugged:d23b38c6-97c2-4c11-b75d-6bd6879bb74d for instance ca40e7b2-fc35-406d-b591-e7e959805790 on hv-cinder-80403 Nov 24 18:51:11.356869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-9fe27cf5-9f92-45e3-91e5-a3a84f24da47 req-607fc3b7-2d14-4aec-b31d-e6b3a2a05c33 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028950 Nov 24 18:51:11.357485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1467/2583] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:51:12.344378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:12.345078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:12.351128 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:12.351573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:12.352342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:12.352769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:12.489370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:12.497376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9d8472a2-bf01-4541-879f-0bf4c21e3d58 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1313 microversion: 2.1 time: 0.158182 Nov 24 18:51:12.498179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1468/2584] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:12 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:13.515000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:13.515530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:13.521987 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:13.522432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:13.523196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:13.523626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:13.657554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:13.665089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5ddae7b0-dee0-4c83-921e-882661bca81f tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1497 microversion: 2.1 time: 0.154457 Nov 24 18:51:13.665678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1469/2585] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:13 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:14.471723 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:14.472521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:14.479123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:14.479921 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:14.481737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:14.482490 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:14.509986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:51:14.795840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-09621e46-e64a-4449-b0aa-9b7ee4d5458b tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "DELETE /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 204 len: 0 microversion: 2.1 time: 0.328409 Nov 24 18:51:14.796560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1470/2586] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:51:14 2021] DELETE /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:51:14.804695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:14.805394 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:14.811548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:14.811999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:14.812820 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:14.813225 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:14.956178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:14.964750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b400c0bf-190f-41f2-a5a9-3cad6729e561 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1503 microversion: 2.1 time: 0.163428 Nov 24 18:51:14.965604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1471/2587] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:14 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:16.031895 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:16.041676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:16.041676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:16.041676 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:16.043742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:16.044319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:16.197777 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:16.206454 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7f56a9b9-daa6-4185-908c-cd4dbb9e07aa tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1503 microversion: 2.1 time: 0.179217 Nov 24 18:51:16.207042 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1472/2588] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:16 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:17.021835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-1856353f-2d61-440e-b89c-19548e72107b req-cb86729e-5990-4ad5-a1dd-e153ae47b774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca40e7b2-fc35-406d-b591-e7e959805790", "name": "network-vif-deleted", "tag": "d23b38c6-97c2-4c11-b75d-6bd6879bb74d"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:17.023310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:17.023310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:17.030946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-1856353f-2d61-440e-b89c-19548e72107b req-cb86729e-5990-4ad5-a1dd-e153ae47b774 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:17.031433 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-1856353f-2d61-440e-b89c-19548e72107b req-cb86729e-5990-4ad5-a1dd-e153ae47b774 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:17.044123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-1856353f-2d61-440e-b89c-19548e72107b req-cb86729e-5990-4ad5-a1dd-e153ae47b774 service nova] Creating event network-vif-deleted:d23b38c6-97c2-4c11-b75d-6bd6879bb74d for instance ca40e7b2-fc35-406d-b591-e7e959805790 on hv-cinder-80403 Nov 24 18:51:17.048916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-1856353f-2d61-440e-b89c-19548e72107b req-cb86729e-5990-4ad5-a1dd-e153ae47b774 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Nov 24 18:51:17.049509 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1473/2589] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:51:17.224297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:17.224986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:17.232753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:17.234194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:17.234194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:17.234470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:17.303216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9946a4c083104c8790c3fdfb8cb339e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd363cce0bea3446c89697a2c34760aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:17.311810 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-62a22030-6bda-42f8-b99c-142f87c91a31 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 200 len: 1298 microversion: 2.1 time: 0.091345 Nov 24 18:51:17.312452 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1474/2590] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:17 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:18.328721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:18.329328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] [instance: ca40e7b2-fc35-406d-b591-e7e959805790] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:18.335718 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:18.336186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:18.336962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:18.337395 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:18.355931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] HTTP exception thrown: Instance ca40e7b2-fc35-406d-b591-e7e959805790 could not be found. Nov 24 18:51:18.356086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] Returning 404 to user: Instance ca40e7b2-fc35-406d-b591-e7e959805790 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:51:18.357299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8108880-8c71-43e1-bf0e-88d8382925b9 tempest-VolumesActionsTest-653721813 tempest-VolumesActionsTest-653721813-project] 10.222.0.53 "GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790" status: 404 len: 111 microversion: 2.1 time: 0.032275 Nov 24 18:51:18.358736 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1475/2591] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:18 2021] GET /compute/v2.1/servers/ca40e7b2-fc35-406d-b591-e7e959805790 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:51:19.935101 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:19.935766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:19.941948 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:19.942386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:19.943138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:19.943572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:20.079429 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:20.088059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-675c9561-942e-4ae1-9f38-95df45793750 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1596 microversion: 2.1 time: 0.156798 Nov 24 18:51:20.088791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1476/2592] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:19 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1596 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:22.574697 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-2a4301e6-d85e-4c15-aeb2-198047dc8eed req-6c4a254d-c89f-4a07-9092-bb0ba6571071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:22.576707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:22.576707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:22.584871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-2a4301e6-d85e-4c15-aeb2-198047dc8eed req-6c4a254d-c89f-4a07-9092-bb0ba6571071 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:22.585712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-2a4301e6-d85e-4c15-aeb2-198047dc8eed req-6c4a254d-c89f-4a07-9092-bb0ba6571071 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:22.605300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-2a4301e6-d85e-4c15-aeb2-198047dc8eed req-6c4a254d-c89f-4a07-9092-bb0ba6571071 service nova] Creating event network-changed:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:51:22.616113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-2a4301e6-d85e-4c15-aeb2-198047dc8eed req-6c4a254d-c89f-4a07-9092-bb0ba6571071 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047163 Nov 24 18:51:22.617091 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1477/2593] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:51:25.254161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2038578663"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:25.255511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:25.263240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:25.263692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:25.264559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:25.264995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:25.524720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.network.security_group_api [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Adding security group b132472b-73d9-40ab-af81-0d5c7dbbac19 to port 197be339-1cd8-4413-a406-ef1ede79aa07 Nov 24 18:51:26.193554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-39b4abe4-0383-4353-b759-1544da51a8a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action" status: 202 len: 0 microversion: 2.1 time: 0.944864 Nov 24 18:51:26.195256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1478/2594] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:51:25 2021] POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action => generated 0 bytes in 947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:51:26.203867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-e74c1300-808b-4b2e-bbec-2c6dec473b1e req-a3a24f32-19ad-4602-970d-951b03c71100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:26.205648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:51:26.205648 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:51:26.213862 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e74c1300-808b-4b2e-bbec-2c6dec473b1e req-a3a24f32-19ad-4602-970d-951b03c71100 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:26.214547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e74c1300-808b-4b2e-bbec-2c6dec473b1e req-a3a24f32-19ad-4602-970d-951b03c71100 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:26.244388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-e74c1300-808b-4b2e-bbec-2c6dec473b1e req-a3a24f32-19ad-4602-970d-951b03c71100 service nova] Creating event network-changed:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:51:26.270378 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-e74c1300-808b-4b2e-bbec-2c6dec473b1e req-a3a24f32-19ad-4602-970d-951b03c71100 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069363 Nov 24 18:51:26.292760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1479/2595] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:51:26.306106 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:26.311909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:26.325753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:26.326850 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:26.330567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:26.331302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:26.732529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:26.749556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c7b89dd0-8b85-44a3-98d2-43b8a56e6ada tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1761 microversion: 2.1 time: 0.454358 Nov 24 18:51:26.750731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1480/2596] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:26 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1761 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:51:55.870750 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:55.871886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:55.878228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:55.878681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:55.879604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:55.880030 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:56.148447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ba431490-4b06-466d-a53a-dc1163bc42f1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action" status: 202 len: 0 microversion: 2.1 time: 0.281790 Nov 24 18:51:56.149111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1481/2597] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:51:55 2021] POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:51:56.157747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:56.158497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:56.165597 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:56.166154 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:56.171845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:56.171845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:56.315844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:56.323714 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8c090770-f472-40c4-abe6-c8baf46b4145 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1753 microversion: 2.1 time: 0.169677 Nov 24 18:51:56.337400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1482/2598] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:56 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:57.342228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:57.342912 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:57.348840 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:57.349283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:57.350094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:57.350522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:57.495477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:57.503908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-00181c14-5f82-43ee-9d7a-51255b3b4e75 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.165980 Nov 24 18:51:57.504480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1483/2599] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:57 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:58.521056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:58.521674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:58.528011 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:58.528456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:58.529510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:58.529982 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:58.694037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:58.704662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4659d140-c55c-4e4e-8feb-86af5e523ffa tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.187137 Nov 24 18:51:58.707642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1484/2600] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:58 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:58.888087 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-431884406", "imageRef": "e64384b7-b907-4285-849f-ffc9e5393e5d", "flavorRef": "452"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:51:58.942968 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] validate_networks() for None {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:51:59.224753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:51:59.225178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:51:59.225695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:51:59.226356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:51:59.226760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:51:59.237614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:59.238094 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:59.238894 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:59.239384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:59.257202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Getting quotas for project b1aa39c9f5f74bbdacac62a285115b89. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:51:59.262317 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Getting quotas for user 92af13f021af4d87b0cf26a9fb5ae154 and project b1aa39c9f5f74bbdacac62a285115b89. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:51:59.275223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:51:59.277553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e64384b7-b907-4285-849f-ffc9e5393e5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:51:59.403291 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bda32913-af2d-4c97-bda7-6616a1a606f6 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518721 Nov 24 18:51:59.403978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1485/2601] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:51:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:51:59.414113 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-65ec8ef1-dcd7-4fe8-b5cd-0f5236bc01f5 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:59.414712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-65ec8ef1-dcd7-4fe8-b5cd-0f5236bc01f5 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:59.472596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-65ec8ef1-dcd7-4fe8-b5cd-0f5236bc01f5 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:59.479102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-65ec8ef1-dcd7-4fe8-b5cd-0f5236bc01f5 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1214 microversion: 2.1 time: 0.068599 Nov 24 18:51:59.479923 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1486/2602] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:59 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:51:59.731123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:51:59.731123 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:51:59.733242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:59.733856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:59.734819 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:51:59.735651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:51:59.891314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:51:59.901195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71a4fe59-4389-4c42-ad20-38afaaea2cfb tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.179779 Nov 24 18:51:59.901195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1487/2603] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:51:59 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:00.496302 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:00.496998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:00.503735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:00.504260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:00.505115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:00.505613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:00.585100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:00.593994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-13ced21e-d88e-4800-aa24-fe0057e91e4d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1218 microversion: 2.1 time: 0.101451 Nov 24 18:52:00.594557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1488/2604] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:00 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:00.917307 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:00.918035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:00.925788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:00.926242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:00.927613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:00.928057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:01.084946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:01.092978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-cece6537-bda1-4c0d-a017-010853ee8d33 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.179875 Nov 24 18:52:01.096540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1489/2605] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:00 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:01.611277 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:01.611794 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:01.617732 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:01.618220 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:01.619002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:01.619442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:01.683560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:01.692609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e1b74b06-329d-4e9f-985f-0fc12c8fc615 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1274 microversion: 2.1 time: 0.085596 Nov 24 18:52:01.693376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1490/2606] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:01 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:02.110312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:02.110956 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:02.117327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:02.117719 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:02.118537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:02.121431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:02.366610 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:02.377045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b8b97c25-351f-4695-b23f-a29b458eb3b7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.270946 Nov 24 18:52:02.377665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1491/2607] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:02 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:02.709978 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:02.710591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:02.717340 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:02.717823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:02.718596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:02.719156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:02.778463 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:02.786985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2910630f-0d06-4ae3-9aee-4b2a8c4a623e tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1272 microversion: 2.1 time: 0.080639 Nov 24 18:52:02.787770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1492/2608] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:02 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:03.394596 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:03.395445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:03.403698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:03.405386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:03.406249 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:03.406870 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:03.574721 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:03.582621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5c732030-8151-44e0-af49-2f6412d15763 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.191756 Nov 24 18:52:03.583236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1493/2609] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:03 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:03.805032 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:03.805813 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:03.813946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:03.814399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:03.815174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:03.815639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:03.952480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:03.962357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-baa89b90-ac5c-4b8b-93ce-a56bf31cbda7 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.160820 Nov 24 18:52:03.965206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1494/2610] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:03 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:03.977537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-8e96400e-8a60-459f-bc94-fc4428f4d064 req-5393cb31-4b74-49de-817d-554d5de70991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da05cf93-b2bc-4e10-9c9f-c333c86d57bd", "tag": "cff2416e-43ba-43eb-a246-1cf79ffdc8a2"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:03.980237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:03.980237 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:03.990972 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-8e96400e-8a60-459f-bc94-fc4428f4d064 req-5393cb31-4b74-49de-817d-554d5de70991 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:03.991422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-8e96400e-8a60-459f-bc94-fc4428f4d064 req-5393cb31-4b74-49de-817d-554d5de70991 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:04.006682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-8e96400e-8a60-459f-bc94-fc4428f4d064 req-5393cb31-4b74-49de-817d-554d5de70991 service nova] Creating event network-changed:cff2416e-43ba-43eb-a246-1cf79ffdc8a2 for instance da05cf93-b2bc-4e10-9c9f-c333c86d57bd on hv-cinder-80403 Nov 24 18:52:04.012385 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-8e96400e-8a60-459f-bc94-fc4428f4d064 req-5393cb31-4b74-49de-817d-554d5de70991 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042219 Nov 24 18:52:04.013893 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1495/2611] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:52:04.603181 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:04.603993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:04.611256 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:04.611699 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:04.612470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:04.613068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:04.766242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:04.774646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d572d58f-561d-4bd5-a673-b0ea70a874e1 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.175496 Nov 24 18:52:04.775215 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1496/2612] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:04 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:04.981331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:04.982679 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:04.991637 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:04.992145 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:04.992930 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:04.993455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:05.143437 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:05.150760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4f29592f-b06a-4115-99d1-927db0e54f28 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.173462 Nov 24 18:52:05.151330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1497/2613] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:04 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:05.792322 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:05.793669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:05.800932 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:05.801391 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:05.802200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:05.802638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:05.950495 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:05.959089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-35faf782-99ba-49e4-b2ba-f794b7d94c72 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.170341 Nov 24 18:52:05.959654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1498/2614] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:05 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:06.167466 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:06.168230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:06.175295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:06.175738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:06.176536 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:06.176973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:06.315573 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:06.323240 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fe0f6910-db71-4dbc-a7b2-4f10901cbf3d tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.159302 Nov 24 18:52:06.324057 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1499/2615] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:06 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:06.976477 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:06.978285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:06.986873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:06.987331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:06.988122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:06.988559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:07.237523 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:07.245535 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-321f5cf3-b4ae-4768-be11-c4d3491b6e3c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.272942 Nov 24 18:52:07.246138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1500/2616] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:06 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:07.342367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:07.343369 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:07.349352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:07.349849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:07.350646 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:07.351132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:07.531865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:07.540651 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4ce04ffe-9216-4b17-896d-bb1c362d07f4 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.202982 Nov 24 18:52:07.542055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1501/2617] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:07 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:08.263469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:08.264184 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:08.271580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:08.272024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:08.278519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:08.278519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:08.547000 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:08.573339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e8e0d898-cc7a-4df8-a5ec-fe16ed459f3b tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.313556 Nov 24 18:52:08.573988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1502/2618] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:08 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:08.582045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:08.582900 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:08.590105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:08.590560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:08.596692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:08.597232 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:08.837979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:08.848269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f907806c-0df9-4fc4-9561-01e2b9782b60 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.272262 Nov 24 18:52:08.849308 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1503/2619] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:08 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:09.236179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-3bf195ba-ba3f-4e76-b06e-133779ae24bf req-e191e2ed-6317-42ad-9be4-fe688f6dc8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da05cf93-b2bc-4e10-9c9f-c333c86d57bd", "name": "network-vif-plugged", "status": "completed", "tag": "cff2416e-43ba-43eb-a246-1cf79ffdc8a2"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:09.243501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:09.243501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:09.268557 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-3bf195ba-ba3f-4e76-b06e-133779ae24bf req-e191e2ed-6317-42ad-9be4-fe688f6dc8fe service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:09.269164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-3bf195ba-ba3f-4e76-b06e-133779ae24bf req-e191e2ed-6317-42ad-9be4-fe688f6dc8fe service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:09.286008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-3bf195ba-ba3f-4e76-b06e-133779ae24bf req-e191e2ed-6317-42ad-9be4-fe688f6dc8fe service nova] Creating event network-vif-plugged:cff2416e-43ba-43eb-a246-1cf79ffdc8a2 for instance da05cf93-b2bc-4e10-9c9f-c333c86d57bd on hv-cinder-80403 Nov 24 18:52:09.291065 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-3bf195ba-ba3f-4e76-b06e-133779ae24bf req-e191e2ed-6317-42ad-9be4-fe688f6dc8fe service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063533 Nov 24 18:52:09.291897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1504/2620] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:52:09.592222 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:09.592917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:09.599165 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:09.599641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:09.600370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:09.600798 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:09.912692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:09.922548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ad9b9559-c298-49f3-8ef5-5330b0c1bc89 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.334912 Nov 24 18:52:09.932531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1505/2621] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:09 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:09.932531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:09.932531 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:09.934694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:09.936445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:09.937293 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:09.937737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:10.197216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:10.205951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-46db5f97-48c1-4c19-bb82-f2de79852edf tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1314 microversion: 2.1 time: 0.281750 Nov 24 18:52:10.207180 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1506/2622] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:09 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:10.939780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:10.941507 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:10.947835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:10.948279 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:10.949156 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:10.949585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:11.229255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:11.237831 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2c830de0-9bce-43e8-982c-834cfc06d57a tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.301605 Nov 24 18:52:11.248296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1507/2623] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:10 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:11.253650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:11.254506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:11.263934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:11.263934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:11.263934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:11.263934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:11.730848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:11.740104 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a362ba79-353d-4f20-9df5-86f8d6db0242 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1464 microversion: 2.1 time: 0.490403 Nov 24 18:52:11.740992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1508/2624] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:11 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1464 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:11.782079 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:11.783136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:11.791876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:11.791876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:11.791876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:11.791876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:11.819946 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:52:12.168709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e30862f8-7c36-4bb0-a452-1d9ab42c3d56 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "DELETE /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 204 len: 0 microversion: 2.1 time: 0.390291 Nov 24 18:52:12.170510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1509/2625] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:52:11 2021] DELETE /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:52:12.181583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:12.183518 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:12.197053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:12.197621 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:12.199102 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:12.199609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:12.452975 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:12.460527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a6593c45-fd88-4126-b0e1-dd3be19c9211 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1470 microversion: 2.1 time: 0.285749 Nov 24 18:52:12.461722 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1510/2626] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:12 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:12.467039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:12.467823 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:12.474328 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:12.474973 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:12.476471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:12.477053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:12.790959 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:12.800530 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3346b8cb-7eb9-4508-84ab-80e052e404ee tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1758 microversion: 2.1 time: 0.337305 Nov 24 18:52:12.801303 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1511/2627] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:12 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1758 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:13.478204 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:13.479599 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:13.486674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:13.487216 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:13.488070 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:13.488707 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:13.627591 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:13.635337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-23a00736-7031-476c-91fa-e688cd1d94f8 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1470 microversion: 2.1 time: 0.160645 Nov 24 18:52:13.635913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1512/2628] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:13 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:13.819119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:13.819827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:13.827031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:13.827641 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:13.828669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:13.829182 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:14.056712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:14.069132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-888ae28f-afc4-48ca-b2ff-e6889c98971c tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1761 microversion: 2.1 time: 0.251672 Nov 24 18:52:14.069132 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1513/2629] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:13 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1761 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:14.339388 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-a737f0d5-5c6c-4017-b3a8-691be3fd5b9e req-3dee7fcd-47ba-462b-a2d6-a74ac17e5c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da05cf93-b2bc-4e10-9c9f-c333c86d57bd", "name": "network-vif-deleted", "tag": "cff2416e-43ba-43eb-a246-1cf79ffdc8a2"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:14.340909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:14.340909 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:14.354559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-a737f0d5-5c6c-4017-b3a8-691be3fd5b9e req-3dee7fcd-47ba-462b-a2d6-a74ac17e5c77 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:14.355269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-a737f0d5-5c6c-4017-b3a8-691be3fd5b9e req-3dee7fcd-47ba-462b-a2d6-a74ac17e5c77 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:14.375942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-a737f0d5-5c6c-4017-b3a8-691be3fd5b9e req-3dee7fcd-47ba-462b-a2d6-a74ac17e5c77 service nova] Creating event network-vif-deleted:cff2416e-43ba-43eb-a246-1cf79ffdc8a2 for instance da05cf93-b2bc-4e10-9c9f-c333c86d57bd on hv-cinder-80403 Nov 24 18:52:14.381206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-a737f0d5-5c6c-4017-b3a8-691be3fd5b9e req-3dee7fcd-47ba-462b-a2d6-a74ac17e5c77 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045675 Nov 24 18:52:14.384906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1514/2630] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:52:14.656144 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:14.657659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:14.666853 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:14.667402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:14.668295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:14.668834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:14.708386 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:14.709078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:14.709532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lazy-loading 'fault' on Instance uuid da05cf93-b2bc-4e10-9c9f-c333c86d57bd {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:52:14.753399 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92af13f021af4d87b0cf26a9fb5ae154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aa39c9f5f74bbdacac62a285115b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:14.761029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eed1b591-c9f5-4d05-b08c-b2073f9e4443 tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 200 len: 1304 microversion: 2.1 time: 0.110787 Nov 24 18:52:14.761617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1515/2631] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:14 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:15.784578 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:15.786016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] [instance: da05cf93-b2bc-4e10-9c9f-c333c86d57bd] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:15.798702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:15.799548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:15.800864 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:15.801629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:15.826412 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] HTTP exception thrown: Instance da05cf93-b2bc-4e10-9c9f-c333c86d57bd could not be found. Nov 24 18:52:15.827335 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] Returning 404 to user: Instance da05cf93-b2bc-4e10-9c9f-c333c86d57bd could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:52:15.828421 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-023b3ea3-08f0-499c-b395-df4d3b96fdca tempest-VolumesNegativeTest-1341892262 tempest-VolumesNegativeTest-1341892262-project] 10.222.0.53 "GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd" status: 404 len: 111 microversion: 2.1 time: 0.053042 Nov 24 18:52:15.829469 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1516/2632] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:15 2021] GET /compute/v2.1/servers/da05cf93-b2bc-4e10-9c9f-c333c86d57bd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:52:20.486806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Action: 'create', calling method: .version_select at 0x7f8ba85851f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1866583076"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:20.502616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:52:20.506922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for user 23035183c14f453199236832012db067 and project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:52:20.730347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:52:20.734498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for user 23035183c14f453199236832012db067 and project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'key_pairs'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:52:20.748310 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1020cc54-6231-4a1b-928f-cdd51990b91e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.456293 Nov 24 18:52:20.748942 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1517/2633] 10.222.0.53 () {60 vars in 1157 bytes} [Wed Nov 24 18:52:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:37.178564 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:52:37.179107 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:52:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:52:41.008349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-482463396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866583076", "security_groups": [{"name": "tempest-secgroup-smoke-2078851688"}], "block_device_mapping_v2": [{"uuid": "d5b45123-1f2d-4e25-9458-a0e153d656a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c456400a-2f9c-4041-a41b-ea97c6f90e53"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:41.115480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] validate_networks() for [('c456400a-2f9c-4041-a41b-ea97c6f90e53', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:52:41.471814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:52:41.472239 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:52:41.472716 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:52:41.473127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:52:41.473539 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:52:41.482048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:41.482499 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:41.483309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:41.483746 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:41.499580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:52:41.503913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for user 23035183c14f453199236832012db067 and project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:52:41.557938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:52:41.560036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5b45123-1f2d-4e25-9458-a0e153d656a4',volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:52:41.921282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e321c057-2dd2-42c2-8bc0-ffef17a7f122 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.916949 Nov 24 18:52:41.922126 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1518/2634] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:52:41 2021] POST /compute/v2.1/servers => generated 406 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:52:41.932693 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5783c905-1fea-464d-aa0b-28b57637e1d2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:41.933299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5783c905-1fea-464d-aa0b-28b57637e1d2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:41.986663 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5783c905-1fea-464d-aa0b-28b57637e1d2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:41.993112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5783c905-1fea-464d-aa0b-28b57637e1d2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1094 microversion: 2.1 time: 0.063973 Nov 24 18:52:41.993666 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1519/2635] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:41 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:43.011681 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:43.012296 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:43.019320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:43.019769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:43.020548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:43.020984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:43.081019 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:43.088243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2f5aeaa9-960a-4111-aa7e-ec105a3d665f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1144 microversion: 2.1 time: 0.080336 Nov 24 18:52:43.088814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1520/2636] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:43 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:44.105336 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:44.106082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:44.113786 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:44.114231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:44.115001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:44.115430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:44.175273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:44.182731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c1cdf856-09c6-40a3-a2c9-ee2f1e33b94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1200 microversion: 2.1 time: 0.080942 Nov 24 18:52:44.192890 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1521/2637] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:44 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:45.200194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:45.200873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:45.207231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:45.207668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:45.208427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:45.208896 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:45.359920 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:45.368711 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bb6379f8-d1b9-4085-8ddb-d92fd8892a87 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1278 microversion: 2.1 time: 0.172015 Nov 24 18:52:45.369694 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1522/2638] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:45 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:45.598848 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-57d6f28b-861d-46f4-b54e-4dc1772e3e78 req-f92d3042-e372-4c90-8f22-e0013cb0bc16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9316c084-364a-44c3-a9bd-083641f6c147", "tag": "33a89cde-da4f-49b4-b763-82e37e32f70e"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:45.600441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:45.600441 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:45.610598 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-57d6f28b-861d-46f4-b54e-4dc1772e3e78 req-f92d3042-e372-4c90-8f22-e0013cb0bc16 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:45.614192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-57d6f28b-861d-46f4-b54e-4dc1772e3e78 req-f92d3042-e372-4c90-8f22-e0013cb0bc16 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:45.624434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-57d6f28b-861d-46f4-b54e-4dc1772e3e78 req-f92d3042-e372-4c90-8f22-e0013cb0bc16 service nova] Creating event network-changed:33a89cde-da4f-49b4-b763-82e37e32f70e for instance 9316c084-364a-44c3-a9bd-083641f6c147 on hv-cinder-80403 Nov 24 18:52:45.631691 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-57d6f28b-861d-46f4-b54e-4dc1772e3e78 req-f92d3042-e372-4c90-8f22-e0013cb0bc16 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037869 Nov 24 18:52:45.632364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1523/2639] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:52:46.387880 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:46.388692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:46.395811 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:46.396267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:46.397048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:46.397485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:46.527940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:46.535119 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-266a12cf-38fa-43d5-a4a0-721e3cc047bb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.151867 Nov 24 18:52:46.535689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1524/2640] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:46 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:47.552121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:47.552749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:47.558998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:47.559447 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:47.560223 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:47.560654 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:47.691983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:47.699099 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5960a3a4-6a84-453d-9263-bfadf9eeed1d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.150627 Nov 24 18:52:47.699660 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1525/2641] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:47 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:48.716150 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:48.716838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:48.723306 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:48.723756 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:48.725479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:48.725952 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:48.859234 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:48.866567 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-99a9f46b-7b3d-41ff-999a-103012855908 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.154024 Nov 24 18:52:48.867142 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1526/2642] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:48 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:49.705016 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2038578663"}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:49.705583 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:49.712235 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:49.715790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:49.715790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:49.715790 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:49.840282 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.network.security_group_api [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Removing security group b132472b-73d9-40ab-af81-0d5c7dbbac19 from port 197be339-1cd8-4413-a406-ef1ede79aa07 Nov 24 18:52:50.230061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5fdbcf98-0d95-441c-a9da-b4a44a0e5dfe tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action" status: 202 len: 0 microversion: 2.1 time: 0.528639 Nov 24 18:52:50.234633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1527/2643] 10.222.0.53 () {60 vars in 1277 bytes} [Wed Nov 24 18:52:49 2021] POST /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:52:50.240304 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:50.241580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:50.248247 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:50.248787 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:50.249682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:50.250138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:50.444230 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:50.451913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7b69b6e7-f57a-4bf7-b954-f2c5d1f6aedb tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.216653 Nov 24 18:52:50.452576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1528/2644] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:50 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:50.459976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-c8943525-09b1-4f24-a927-ceb004c78eac req-354d65af-452b-4e0d-a201-2f66926a858f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:50.467532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:50.467532 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:50.468939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-c8943525-09b1-4f24-a927-ceb004c78eac req-354d65af-452b-4e0d-a201-2f66926a858f service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:50.469382 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-c8943525-09b1-4f24-a927-ceb004c78eac req-354d65af-452b-4e0d-a201-2f66926a858f service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:50.480901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-c8943525-09b1-4f24-a927-ceb004c78eac req-354d65af-452b-4e0d-a201-2f66926a858f service nova] Creating event network-changed:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:52:50.485720 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-c8943525-09b1-4f24-a927-ceb004c78eac req-354d65af-452b-4e0d-a201-2f66926a858f service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031804 Nov 24 18:52:50.486366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1529/2645] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:52:51.451745 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:51.452351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:51.458500 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.458939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:51.459703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.460129 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:51.539629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lazy-loading 'services' on Instance uuid 898e3cc5-2d43-49d2-9787-d1ab58513db1 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:52:51.795735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4ba300a0-bfc9-47fa-a161-68c15d607fc7 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments/8d4cf377-9152-4cce-a97c-d36c7198aa27" status: 202 len: 0 microversion: 2.1 time: 0.348296 Nov 24 18:52:51.796674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1530/2646] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:52:51 2021] DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments/8d4cf377-9152-4cce-a97c-d36c7198aa27 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:52:51.803082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:51.805351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:51.811058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.811515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:51.812367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.813356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:51.950305 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:51.958911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fab53a81-449b-4910-b6b1-3a1a051b3f18 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.160907 Nov 24 18:52:51.959374 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1531/2647] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:51 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:51.968753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:51.968753 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:51.970614 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.971058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:51.971954 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:51.972431 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:52.000855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a9005248-67da-46d7-a535-fe073d153348 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040462 Nov 24 18:52:52.001442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1532/2648] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:52:51 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:52:52.501418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-c0201d49-bd2b-4ea6-b45d-e0f493477111 req-3fff9dfa-1455-4876-8b57-46e3b1b48f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:52.503506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:52.503506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:52.510727 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-c0201d49-bd2b-4ea6-b45d-e0f493477111 req-3fff9dfa-1455-4876-8b57-46e3b1b48f1e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:52.511356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-c0201d49-bd2b-4ea6-b45d-e0f493477111 req-3fff9dfa-1455-4876-8b57-46e3b1b48f1e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:52.522407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-c0201d49-bd2b-4ea6-b45d-e0f493477111 req-3fff9dfa-1455-4876-8b57-46e3b1b48f1e service nova] Creating event network-changed:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:52:52.527115 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-c0201d49-bd2b-4ea6-b45d-e0f493477111 req-3fff9dfa-1455-4876-8b57-46e3b1b48f1e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029208 Nov 24 18:52:52.527692 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1533/2649] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:52:52.976675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:52.977383 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:52.983796 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:52.984327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:52.985174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:52.985638 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:53.127403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:53.136443 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8feee56d-34b0-4834-9265-f8780135293c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.164507 Nov 24 18:52:53.137210 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1534/2650] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:52 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:53.141822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:53.142733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:53.150072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:53.150327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:53.151109 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:53.151543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:53.181625 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2ffb4533-6cd5-4739-89be-413a4a83d0ae tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043233 Nov 24 18:52:53.182827 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1535/2651] 10.222.0.53 () {58 vars in 1301 bytes} [Wed Nov 24 18:52:53 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:52:53.199012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:53.199908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:53.210743 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:53.211202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:53.212266 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:53.212704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:53.289299 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] HTTP exception thrown: Instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 is not attached to volume 8d4cf377-9152-4cce-a97c-d36c7198aa27 Nov 24 18:52:53.289933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Returning 404 to user: Instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 is not attached to volume 8d4cf377-9152-4cce-a97c-d36c7198aa27 {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:52:53.290773 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6b70b1f4-bf39-4b16-b919-f2370a6aeaea tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments/8d4cf377-9152-4cce-a97c-d36c7198aa27" status: 404 len: 154 microversion: 2.1 time: 0.098145 Nov 24 18:52:53.291406 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1536/2652] 10.222.0.53 () {58 vars in 1415 bytes} [Wed Nov 24 18:52:53 2021] DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1/os-volume_attachments/8d4cf377-9152-4cce-a97c-d36c7198aa27 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:52:54.154445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:54.155068 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:54.161874 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.162313 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:54.163069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.163497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:54.293063 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:54.300545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0e14ba1e-c08f-4e80-a47f-5271b97bf99c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.149768 Nov 24 18:52:54.301105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1537/2653] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:54 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:54.553788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:54.554295 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:54.560136 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.560586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:54.561357 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.561804 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:54.585728 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:52:54.870635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d2575409-f091-4c5c-b34c-66a3f63b70af tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 204 len: 0 microversion: 2.1 time: 0.320600 Nov 24 18:52:54.871141 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1538/2654] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:52:54 2021] DELETE /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:52:54.879083 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:54.879762 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:54.885333 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.885802 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:54.886571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:54.887008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:55.018538 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:55.025731 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-1aa027fe-ab1e-4afb-8cb4-8b47cf9fdd4e tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1556 microversion: 2.1 time: 0.150417 Nov 24 18:52:55.026343 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1539/2655] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:54 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:55.263594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-82068247-200b-450b-9139-159ccee7af21 req-2c8fbe9e-8bb3-4155-9a15-110acac6d53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9316c084-364a-44c3-a9bd-083641f6c147", "name": "network-vif-plugged", "status": "completed", "tag": "33a89cde-da4f-49b4-b763-82e37e32f70e"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:55.265146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:55.265146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:55.272593 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-82068247-200b-450b-9139-159ccee7af21 req-2c8fbe9e-8bb3-4155-9a15-110acac6d53b service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:55.273031 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-82068247-200b-450b-9139-159ccee7af21 req-2c8fbe9e-8bb3-4155-9a15-110acac6d53b service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:55.283330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-82068247-200b-450b-9139-159ccee7af21 req-2c8fbe9e-8bb3-4155-9a15-110acac6d53b service nova] Creating event network-vif-plugged:33a89cde-da4f-49b4-b763-82e37e32f70e for instance 9316c084-364a-44c3-a9bd-083641f6c147 on hv-cinder-80403 Nov 24 18:52:55.288298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-82068247-200b-450b-9139-159ccee7af21 req-2c8fbe9e-8bb3-4155-9a15-110acac6d53b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028232 Nov 24 18:52:55.298653 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1540/2656] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:52:55.318708 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:55.319468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:55.325568 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:55.327379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:55.327379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:55.327379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:55.469337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:55.476814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c45b7c6e-04ad-4942-9553-5f21a3bcef8b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.163362 Nov 24 18:52:55.477460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1541/2657] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:55 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:56.042764 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:56.043373 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:56.049170 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:56.049626 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:56.051082 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:56.051519 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:56.181446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:56.188605 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-d662262f-ffa4-4ec4-9464-48ba3d22c753 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1556 microversion: 2.1 time: 0.149549 Nov 24 18:52:56.189163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1542/2658] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:56 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:56.495738 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:56.496384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:56.502639 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:56.503162 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:56.503917 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:56.504354 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:56.637413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:56.645805 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a0fb7109-258e-4337-aa86-9782800109d4 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1266 microversion: 2.1 time: 0.153693 Nov 24 18:52:56.646348 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1543/2659] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:56 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:57.205962 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:57.207002 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:57.213036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.217137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.217137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.217137 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.344907 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:57.353108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-32d44ff6-6b08-41d0-8105-2000f4bf60b9 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1556 microversion: 2.1 time: 0.151093 Nov 24 18:52:57.353678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1544/2660] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:57 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:57.460642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-cb4e209a-6182-4215-b402-c1fe55206f96 req-ed8de640-78b4-47a4-a38c-30f19ccd428c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898e3cc5-2d43-49d2-9787-d1ab58513db1", "name": "network-vif-deleted", "tag": "197be339-1cd8-4413-a406-ef1ede79aa07"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:52:57.460642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:52:57.460642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:52:57.465488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-cb4e209a-6182-4215-b402-c1fe55206f96 req-ed8de640-78b4-47a4-a38c-30f19ccd428c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.468405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-cb4e209a-6182-4215-b402-c1fe55206f96 req-ed8de640-78b4-47a4-a38c-30f19ccd428c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.477108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-cb4e209a-6182-4215-b402-c1fe55206f96 req-ed8de640-78b4-47a4-a38c-30f19ccd428c service nova] Creating event network-vif-deleted:197be339-1cd8-4413-a406-ef1ede79aa07 for instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 on hv-cinder-80403 Nov 24 18:52:57.481835 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-cb4e209a-6182-4215-b402-c1fe55206f96 req-ed8de640-78b4-47a4-a38c-30f19ccd428c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028921 Nov 24 18:52:57.482422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1545/2661] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:52:57.663036 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:57.663760 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:57.669950 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.670442 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.671174 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.671609 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.812841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:57.821416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a653a6d7-cd20-40c4-98bf-59665b24b626 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1453 microversion: 2.1 time: 0.162861 Nov 24 18:52:57.822035 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1546/2662] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:57 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:52:57.838803 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:57.839438 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:57.845522 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.846005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.847562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:57.848428 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:57.983792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:57.991472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-0792515c-b02b-4964-90e1-c9426de92e9d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1453 microversion: 2.1 time: 0.156203 Nov 24 18:52:57.992020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1547/2663] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:57 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:58.370550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:58.371342 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:58.377635 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:58.382397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:58.382397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:58.382397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:58.412943 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:58.413417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:58.413884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lazy-loading 'fault' on Instance uuid 898e3cc5-2d43-49d2-9787-d1ab58513db1 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:52:58.465289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20770fc7551413f8981cb075e6ea13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05fb7f9c87945209429bb1cada0530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:52:58.473636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-658511aa-1bcb-429d-aad5-a67653ce38b4 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 200 len: 1349 microversion: 2.1 time: 0.106589 Nov 24 18:52:58.474525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1548/2664] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:58 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:52:59.491275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:59.491938 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] [instance: 898e3cc5-2d43-49d2-9787-d1ab58513db1] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:52:59.498327 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:59.498765 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:59.499585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:52:59.500047 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:52:59.514462 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] HTTP exception thrown: Instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 could not be found. Nov 24 18:52:59.522849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Returning 404 to user: Instance 898e3cc5-2d43-49d2-9787-d1ab58513db1 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:52:59.522849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-61456402-d543-4a92-b103-1516fd2d74a6 tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1" status: 404 len: 111 microversion: 2.1 time: 0.029195 Nov 24 18:52:59.522849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1549/2665] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:52:59 2021] GET /compute/v2.1/servers/898e3cc5-2d43-49d2-9787-d1ab58513db1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:52:59.524364 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-eca635e9-e14f-417f-83df-69817772780d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] Calling method '.version_select at 0x7f8bacbc4d30>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:52:59.603418 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-eca635e9-e14f-417f-83df-69817772780d tempest-TestMinimumBasicScenario-557462845 tempest-TestMinimumBasicScenario-557462845-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2035171140" status: 202 len: 0 microversion: 2.1 time: 0.082352 Nov 24 18:52:59.604009 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1550/2666] 10.222.0.53 () {58 vars in 1271 bytes} [Wed Nov 24 18:52:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2035171140 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:53:00.311809 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-25b6017f-d2a6-44c6-99c5-746911c71f99 req-4c691b84-ba4c-40af-b300-1523e479b006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9316c084-364a-44c3-a9bd-083641f6c147", "tag": "33a89cde-da4f-49b4-b763-82e37e32f70e"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:53:00.313671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:53:00.313671 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:53:00.321319 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-25b6017f-d2a6-44c6-99c5-746911c71f99 req-4c691b84-ba4c-40af-b300-1523e479b006 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:53:00.321791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-25b6017f-d2a6-44c6-99c5-746911c71f99 req-4c691b84-ba4c-40af-b300-1523e479b006 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:53:00.338198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-25b6017f-d2a6-44c6-99c5-746911c71f99 req-4c691b84-ba4c-40af-b300-1523e479b006 service nova] Creating event network-changed:33a89cde-da4f-49b4-b763-82e37e32f70e for instance 9316c084-364a-44c3-a9bd-083641f6c147 on hv-cinder-80403 Nov 24 18:53:00.342321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-25b6017f-d2a6-44c6-99c5-746911c71f99 req-4c691b84-ba4c-40af-b300-1523e479b006 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034714 Nov 24 18:53:00.342994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1551/2667] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:53:49.689171 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:53:49.689641 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:53:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:54:54.682888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf247785-a5ca-4f18-abb7-8062261dd500] AMQP server on 10.222.0.53:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 24 18:54:54.687352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:54.687925 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:54.693979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:54.694422 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:54.695178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:54.695606 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:54.719510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:54:54.986024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f1a46dcc-9a69-45b7-8c24-0fd31dd9e17c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 204 len: 0 microversion: 2.1 time: 0.304812 Nov 24 18:54:54.986613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1552/2668] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:54:54 2021] DELETE /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:54:54.994445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:54.995139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:55.001885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:55.002339 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:55.003110 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:55.003552 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:55.134127 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:54:55.142058 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-8797e968-ef54-460c-86d1-406b1bd48358 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1578 microversion: 2.1 time: 0.150994 Nov 24 18:54:55.142628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1553/2669] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:54:54 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:54:56.159255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:56.159931 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:56.176432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:56.176886 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:56.177662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:56.178124 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:56.183479 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf247785-a5ca-4f18-abb7-8062261dd500] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 52688. Nov 24 18:54:56.315642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:54:56.322913 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2641dc53-eadb-45c3-a6d8-7d2a6f7f1d77 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1578 microversion: 2.1 time: 0.167338 Nov 24 18:54:56.323470 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1554/2670] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:54:56 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:54:57.340243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:57.341039 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:57.347554 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:57.347996 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:57.348781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:57.349189 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:57.482652 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:54:57.491363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-509cb433-8757-4437-ab1e-1ab7158b5295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1578 microversion: 2.1 time: 0.154733 Nov 24 18:54:57.492029 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1555/2671] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:54:57 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:54:57.891264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-d691f364-adc4-4ab3-87b6-8f3f1ef3ac5a req-c895f863-7992-45ff-b721-94e576191a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9316c084-364a-44c3-a9bd-083641f6c147", "name": "network-vif-deleted", "tag": "33a89cde-da4f-49b4-b763-82e37e32f70e"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:54:57.893926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:54:57.893926 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:54:57.901911 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-d691f364-adc4-4ab3-87b6-8f3f1ef3ac5a req-c895f863-7992-45ff-b721-94e576191a7e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:57.902352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-d691f364-adc4-4ab3-87b6-8f3f1ef3ac5a req-c895f863-7992-45ff-b721-94e576191a7e service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:57.915048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-d691f364-adc4-4ab3-87b6-8f3f1ef3ac5a req-c895f863-7992-45ff-b721-94e576191a7e service nova] Creating event network-vif-deleted:33a89cde-da4f-49b4-b763-82e37e32f70e for instance 9316c084-364a-44c3-a9bd-083641f6c147 on hv-cinder-80403 Nov 24 18:54:57.920742 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-d691f364-adc4-4ab3-87b6-8f3f1ef3ac5a req-c895f863-7992-45ff-b721-94e576191a7e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179876 Nov 24 18:54:57.924229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1556/2672] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:54:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:54:58.509416 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:58.510176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:58.517283 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:58.517733 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:58.518588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:58.519024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:58.555398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:58.555398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:58.555398 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lazy-loading 'fault' on Instance uuid 9316c084-364a-44c3-a9bd-083641f6c147 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:54:58.597203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:54:58.604849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3f071146-3d6f-493f-805d-ab993f77a4b6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 200 len: 1230 microversion: 2.1 time: 0.100069 Nov 24 18:54:58.616512 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1557/2673] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:54:58 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:54:59.622843 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:54:59.623456 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:54:59.629891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:59.630344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:59.631108 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:54:59.631559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:54:59.647284 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] HTTP exception thrown: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. Nov 24 18:54:59.647858 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Returning 404 to user: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:54:59.648677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-323cffe4-fc54-413b-8a14-1d8b2378bac6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 404 len: 111 microversion: 2.1 time: 0.029588 Nov 24 18:54:59.649205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1558/2674] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:54:59 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:54:59.742520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1719286960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866583076", "security_groups": [{"name": "tempest-secgroup-smoke-2078851688"}], "block_device_mapping_v2": [{"uuid": "d5b45123-1f2d-4e25-9458-a0e153d656a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c456400a-2f9c-4041-a41b-ea97c6f90e53"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:54:59.851834 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] validate_networks() for [('c456400a-2f9c-4041-a41b-ea97c6f90e53', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:55:00.203675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:55:00.204122 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:55:00.204602 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:55:00.205012 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:55:00.205424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:55:00.214205 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:00.214656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:00.215461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:00.215897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:00.233363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:55:00.237320 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for user 23035183c14f453199236832012db067 and project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:55:00.292034 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:55:00.294197 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5b45123-1f2d-4e25-9458-a0e153d656a4',volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:55:00.721297 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f4e4c5e5-ad39-4a36-ac4a-ed3b80eb3d01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982436 Nov 24 18:55:00.722051 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1559/2675] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:54:59 2021] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:55:00.731662 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a5f783da-4934-433d-8ba7-d195d602f279 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:00.732258 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a5f783da-4934-433d-8ba7-d195d602f279 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:00.783434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a5f783da-4934-433d-8ba7-d195d602f279 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:00.789855 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a5f783da-4934-433d-8ba7-d195d602f279 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1095 microversion: 2.1 time: 0.061888 Nov 24 18:55:00.790410 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1560/2676] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:00 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:01.807761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:01.808396 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:01.817370 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:01.817885 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:01.818669 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:01.819891 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:01.889562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:01.899906 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-20a2ab02-a080-4f15-a06b-34fa24c78a3d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1137 microversion: 2.1 time: 0.094746 Nov 24 18:55:01.900492 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1561/2677] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:01 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:02.918217 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:02.918889 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:02.926073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:02.926529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:02.927321 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:02.927752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:02.988061 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:02.995393 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b7425248-ca60-4c94-89ff-426f8fa60f70 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1211 microversion: 2.1 time: 0.080837 Nov 24 18:55:02.995960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1562/2678] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:02 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:04.013678 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:04.014471 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:04.023400 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:04.023871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:04.024645 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:04.025073 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:04.174603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:04.178497 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b16a6d4c-4490-4d8f-920c-28f102b1bf05 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1279 microversion: 2.1 time: 0.169799 Nov 24 18:55:04.179078 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1563/2679] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:04 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:04.219688 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-4a7abbe3-41c6-4d9a-869c-18a9c4f96ed8 req-84735f5d-a773-4b45-8eb3-d90b63ef968d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9628b4d0-d484-4637-a5a3-3792868763d2", "tag": "f9e64a00-6792-4095-bc8e-7e6183370793"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:55:04.223878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:55:04.223878 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:55:04.232072 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-4a7abbe3-41c6-4d9a-869c-18a9c4f96ed8 req-84735f5d-a773-4b45-8eb3-d90b63ef968d service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:04.232585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-4a7abbe3-41c6-4d9a-869c-18a9c4f96ed8 req-84735f5d-a773-4b45-8eb3-d90b63ef968d service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:04.246572 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-4a7abbe3-41c6-4d9a-869c-18a9c4f96ed8 req-84735f5d-a773-4b45-8eb3-d90b63ef968d service nova] Creating event network-changed:f9e64a00-6792-4095-bc8e-7e6183370793 for instance 9628b4d0-d484-4637-a5a3-3792868763d2 on hv-cinder-80403 Nov 24 18:55:04.252849 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-4a7abbe3-41c6-4d9a-869c-18a9c4f96ed8 req-84735f5d-a773-4b45-8eb3-d90b63ef968d service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035739 Nov 24 18:55:04.253537 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1564/2680] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:55:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:55:05.196069 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:05.196769 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:05.203160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:05.203617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:05.204390 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:05.205506 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:05.339089 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:05.347423 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3c675e7f-fd87-4504-999c-22a5c69d64ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.155389 Nov 24 18:55:05.347989 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1565/2681] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:05 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:06.364622 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:06.365292 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:06.371521 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:06.371970 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:06.372735 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:06.373171 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:06.504525 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:06.511766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a7b7f412-37e4-45de-89c9-46521c162a1c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.151314 Nov 24 18:55:06.512334 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1566/2682] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:06 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:07.529455 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:07.530147 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:07.537202 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:07.537685 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:07.538493 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:07.538937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:07.667815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:07.675112 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b21719a6-e243-46dc-aa42-c0db3a82032d tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.149323 Nov 24 18:55:07.675677 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1567/2683] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:07 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:08.692381 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:08.693046 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:08.699245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:08.699686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:08.700461 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:08.700902 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:08.833037 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:08.840267 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-42f5c57e-6865-424a-a0b2-bcc1018db295 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.152226 Nov 24 18:55:08.840869 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1568/2684] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:08 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:09.857901 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:09.858548 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:09.864617 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:09.865071 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:09.865866 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:09.866338 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:09.993604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:10.000807 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c313ed36-0c3e-4ed4-9bba-f30c033445ec tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.146816 Nov 24 18:55:10.001377 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1569/2685] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:09 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:11.019194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:11.020198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:11.028332 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:11.028915 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:11.030244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:11.030985 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:11.179713 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:11.188604 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ed8bc7e4-a10f-4861-9f5f-a4631a333169 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.174656 Nov 24 18:55:11.191483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1570/2686] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:11 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:12.206841 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:12.207488 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:12.213664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:12.214146 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:12.214947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:12.215387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:12.446062 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:12.453289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c617f55e-5e23-425a-bf35-232a5e2eb94f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.250147 Nov 24 18:55:12.453884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1571/2687] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:12 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:13.469860 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:13.470501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:13.476752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:13.477194 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:13.477997 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:13.478427 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:13.610837 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:13.619015 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-85001367-7145-4bf8-8c09-95f44405a9f0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.152843 Nov 24 18:55:13.619576 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1572/2688] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:13 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:14.040352 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-e9de33d2-fc49-4272-8f1e-45f7c98da943 req-8d5c7a1c-50bc-4a69-aa40-9eae4aa5ebbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9628b4d0-d484-4637-a5a3-3792868763d2", "name": "network-vif-plugged", "status": "completed", "tag": "f9e64a00-6792-4095-bc8e-7e6183370793"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:55:14.042472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:55:14.042472 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:55:14.048937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e9de33d2-fc49-4272-8f1e-45f7c98da943 req-8d5c7a1c-50bc-4a69-aa40-9eae4aa5ebbd service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:14.049937 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-e9de33d2-fc49-4272-8f1e-45f7c98da943 req-8d5c7a1c-50bc-4a69-aa40-9eae4aa5ebbd service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:14.060594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-e9de33d2-fc49-4272-8f1e-45f7c98da943 req-8d5c7a1c-50bc-4a69-aa40-9eae4aa5ebbd service nova] Creating event network-vif-plugged:f9e64a00-6792-4095-bc8e-7e6183370793 for instance 9628b4d0-d484-4637-a5a3-3792868763d2 on hv-cinder-80403 Nov 24 18:55:14.065951 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-e9de33d2-fc49-4272-8f1e-45f7c98da943 req-8d5c7a1c-50bc-4a69-aa40-9eae4aa5ebbd service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029034 Nov 24 18:55:14.071314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1573/2689] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:55:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:55:14.637376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:14.638092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:14.644501 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:14.644940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:14.645695 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:14.646151 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:14.776710 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:14.784939 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e2f8df65-a835-40b6-a7d2-eb9d47fde203 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1267 microversion: 2.1 time: 0.150913 Nov 24 18:55:14.785510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1574/2690] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:14 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:15.801682 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:15.802346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:15.808584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:15.808998 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:15.809749 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:15.810203 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:15.940781 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:15.948026 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-571eabd3-8f76-4f17-bcde-10679939c5e7 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1454 microversion: 2.1 time: 0.149999 Nov 24 18:55:15.948588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1575/2691] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:15 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:15.964358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:55:15.964955 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:55:15.970665 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:15.973867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:15.973867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:15.973867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:16.104209 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:55:16.111498 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-78867e63-8871-4f3a-ac0b-e3521a711c36 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1454 microversion: 2.1 time: 0.150569 Nov 24 18:55:16.112664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1576/2692] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:55:15 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:55:18.309116 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-05436993-ee9d-4629-8c46-2f9f06c16270 req-f0374eb3-169d-4850-b0f2-8306714c1a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9628b4d0-d484-4637-a5a3-3792868763d2", "tag": "f9e64a00-6792-4095-bc8e-7e6183370793"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:55:18.311570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:55:18.311570 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:55:18.320163 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-05436993-ee9d-4629-8c46-2f9f06c16270 req-f0374eb3-169d-4850-b0f2-8306714c1a74 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:55:18.320704 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-05436993-ee9d-4629-8c46-2f9f06c16270 req-f0374eb3-169d-4850-b0f2-8306714c1a74 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:55:18.333650 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-05436993-ee9d-4629-8c46-2f9f06c16270 req-f0374eb3-169d-4850-b0f2-8306714c1a74 service nova] Creating event network-changed:f9e64a00-6792-4095-bc8e-7e6183370793 for instance 9628b4d0-d484-4637-a5a3-3792868763d2 on hv-cinder-80403 Nov 24 18:55:18.338402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-05436993-ee9d-4629-8c46-2f9f06c16270 req-f0374eb3-169d-4850-b0f2-8306714c1a74 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032913 Nov 24 18:55:18.338993 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1577/2693] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:55:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:55:55.157287 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:55:55.158022 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 18:55:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:55:57.195394 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:55:57.195801 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:55:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:56:52.980092 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1192551757", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866583076", "security_groups": [{"name": "tempest-secgroup-smoke-2078851688"}], "block_device_mapping_v2": [{"uuid": "c3b93468-149d-4c9a-9725-4c15304ef7cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c456400a-2f9c-4041-a41b-ea97c6f90e53"}]}} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:56:53.088817 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.network.neutron [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] validate_networks() for [('c456400a-2f9c-4041-a41b-ea97c6f90e53', None, None, None, None, None)] {{(pid=116730) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 18:56:53.490559 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:56:53.490984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image limits 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:56:53.491457 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Flavor pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:56:53.491867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Image pref 0:0:0 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:56:53.492280 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.virt.hardware [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:56:53.500876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:53.501323 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:53.502166 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:53.502603 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:53.519231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:56:53.523085 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.quota [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Getting quotas for user 23035183c14f453199236832012db067 and project f0bf4bc532e74d50a5a78bd2c5fc31cd. Resources: {'instances', 'ram', 'cores'} {{(pid=116730) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:56:53.577529 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Going to run 1 instances... {{(pid=116730) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 18:56:53.579822 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3b93468-149d-4c9a-9725-4c15304ef7cf',volume_size=None,volume_type=None)] {{(pid=116730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 18:56:53.981480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f604225d-0dc0-4458-8da4-a02cae9b7217 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007316 Nov 24 18:56:53.983048 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1578/2694] 10.222.0.53 () {60 vars in 1146 bytes} [Wed Nov 24 18:56:52 2021] POST /compute/v2.1/servers => generated 406 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:56:53.992027 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c37ecc6c-8900-4b46-aa5c-5f95cbac300b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:53.992629 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c37ecc6c-8900-4b46-aa5c-5f95cbac300b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:54.045534 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c37ecc6c-8900-4b46-aa5c-5f95cbac300b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:54.052751 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c37ecc6c-8900-4b46-aa5c-5f95cbac300b tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1095 microversion: 2.1 time: 0.064154 Nov 24 18:56:54.053318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1579/2695] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:53 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:56:55.069888 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:55.070517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:55.076979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:55.077440 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:55.078245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:55.078683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:55.140387 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:55.148020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-2364d232-43cb-4328-807e-709044887424 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1145 microversion: 2.1 time: 0.081836 Nov 24 18:56:55.148585 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1580/2696] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:55 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:56:56.164207 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:56.166298 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:56.172949 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:56.174594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:56.174594 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:56.174940 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:56.234979 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:56.242857 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-7fe08a61-d764-4aef-8b40-5696c320eeb1 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1211 microversion: 2.1 time: 0.082303 Nov 24 18:56:56.243511 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1581/2697] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:56 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:56:57.260278 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:57.260992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:57.270093 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:57.270542 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:57.275008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:57.275475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:57.443300 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:57.453192 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-10bcc649-e5bb-4f8c-9195-eb303176e1e6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1279 microversion: 2.1 time: 0.196540 Nov 24 18:56:57.453999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1582/2698] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:57 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:56:57.583242 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-5bc57bf8-fe3e-4cfb-b9f0-48ce9786722b req-6e137a89-df25-497b-b1f8-6fe8ab9fe760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3c637b-158c-4a17-aa93-ab4ac00f8857", "tag": "d3299b4c-aecd-4e56-b98a-3e617356c0ad"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:56:57.585033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:56:57.585033 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:56:57.593545 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5bc57bf8-fe3e-4cfb-b9f0-48ce9786722b req-6e137a89-df25-497b-b1f8-6fe8ab9fe760 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:57.596008 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5bc57bf8-fe3e-4cfb-b9f0-48ce9786722b req-6e137a89-df25-497b-b1f8-6fe8ab9fe760 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:57.605744 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-5bc57bf8-fe3e-4cfb-b9f0-48ce9786722b req-6e137a89-df25-497b-b1f8-6fe8ab9fe760 service nova] Creating event network-changed:d3299b4c-aecd-4e56-b98a-3e617356c0ad for instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 on hv-cinder-80403 Nov 24 18:56:57.611478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-5bc57bf8-fe3e-4cfb-b9f0-48ce9786722b req-6e137a89-df25-497b-b1f8-6fe8ab9fe760 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Nov 24 18:56:57.612158 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1583/2699] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:56:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:56:58.471761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:58.472446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:58.478478 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:58.483999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:58.483999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:58.483999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:58.613355 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:58.620550 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-a02eac52-0dd5-47df-93e1-3bdbc22baf3c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.153907 Nov 24 18:56:58.621118 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1584/2700] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:58 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:56:59.637269 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:56:59.637984 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:56:59.645059 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:59.645510 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:59.646312 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:56:59.646747 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:56:59.774199 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:56:59.781856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-76c9a986-c1c9-4dfd-9144-d9d7b6b69ad0 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.148202 Nov 24 18:56:59.782432 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1585/2701] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:56:59 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:00.799346 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:00.800004 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:00.806250 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:00.806698 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:00.807515 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:00.807897 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:00.938424 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:00.945571 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-71fc0bda-232a-4100-9506-19a15710c257 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.150484 Nov 24 18:57:00.946160 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1586/2702] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:00 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:01.962934 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:01.963588 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:01.970260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:01.970703 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:01.971468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:01.971905 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:02.113270 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:02.120590 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-bc053442-9d95-4449-9530-5385f94cf575 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.161371 Nov 24 18:57:02.121149 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1587/2703] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:01 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:03.137800 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:03.138460 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:03.145379 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:03.145844 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:03.146612 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:03.147043 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:03.277337 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:03.284867 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-63672942-c8fc-4ef0-8ee8-1879dc274ecd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.150688 Nov 24 18:57:03.285430 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1588/2704] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:03 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:04.301812 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:04.302453 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:04.308584 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:04.309025 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:04.309801 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:04.310231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:04.441702 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:04.449001 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-4e2bdca4-30be-45cb-bd4a-486eb92ec225 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.150739 Nov 24 18:57:04.449553 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1589/2705] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:04 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:05.466186 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:05.467363 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:05.473966 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:05.474417 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:05.475260 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:05.475696 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:05.604281 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:05.611675 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f76e3965-b6e0-45d5-acd0-f4dc0b095f01 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.149179 Nov 24 18:57:05.612236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1590/2706] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:05 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:06.628096 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:06.628791 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:06.634983 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:06.635434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:06.636206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:06.636642 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:06.774407 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:06.783814 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f01bca73-ba68-45b8-b1ad-db65ee89fdc6 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.159308 Nov 24 18:57:06.793325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1591/2707] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:06 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:06.859195 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-fb162c68-3ed1-421e-a15c-04cd491bab15 req-d10e5086-411d-4249-8c21-c9d25036fdac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3c637b-158c-4a17-aa93-ab4ac00f8857", "name": "network-vif-plugged", "status": "completed", "tag": "d3299b4c-aecd-4e56-b98a-3e617356c0ad"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:57:06.860686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:57:06.860686 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:57:06.867561 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-fb162c68-3ed1-421e-a15c-04cd491bab15 req-d10e5086-411d-4249-8c21-c9d25036fdac service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:06.868245 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-fb162c68-3ed1-421e-a15c-04cd491bab15 req-d10e5086-411d-4249-8c21-c9d25036fdac service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:06.879636 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-fb162c68-3ed1-421e-a15c-04cd491bab15 req-d10e5086-411d-4249-8c21-c9d25036fdac service nova] Creating event network-vif-plugged:d3299b4c-aecd-4e56-b98a-3e617356c0ad for instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 on hv-cinder-80403 Nov 24 18:57:06.884600 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-fb162c68-3ed1-421e-a15c-04cd491bab15 req-d10e5086-411d-4249-8c21-c9d25036fdac service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090031 Nov 24 18:57:06.889288 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1592/2708] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:57:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:57:07.801138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:07.802231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:07.807924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:07.808318 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:07.809090 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:07.809527 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:07.941020 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:07.948196 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-e4f76110-f6fb-490c-9385-938d9d14eac8 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1267 microversion: 2.1 time: 0.151572 Nov 24 18:57:07.948752 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1593/2709] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:07 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:08.965560 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:08.966231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:08.972873 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:08.973325 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:08.974139 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:08.974579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:09.106086 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:09.113779 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5696fd89-4f76-4a2b-a5d0-977a5a56e83f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1453 microversion: 2.1 time: 0.151968 Nov 24 18:57:09.114353 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1594/2710] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:08 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:09.129349 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:57:09.129986 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:57:09.135458 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:09.135908 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:09.136673 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:09.137111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:09.265409 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:57:09.272992 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-ae936721-3eaf-42a9-8b60-4d0a14921fee tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1453 microversion: 2.1 time: 0.146974 Nov 24 18:57:09.273566 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1595/2711] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:57:09 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:57:09.707882 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:57:09.708483 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:57:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 18:57:11.547021 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-5e4e5e16-d09e-44c5-9a3f-a90348fb02f6 req-68671b98-7577-4e4f-92b6-edafaa23c0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3c637b-158c-4a17-aa93-ab4ac00f8857", "tag": "d3299b4c-aecd-4e56-b98a-3e617356c0ad"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:57:11.548579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:57:11.548579 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:57:11.555520 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5e4e5e16-d09e-44c5-9a3f-a90348fb02f6 req-68671b98-7577-4e4f-92b6-edafaa23c0dc service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:57:11.555974 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-5e4e5e16-d09e-44c5-9a3f-a90348fb02f6 req-68671b98-7577-4e4f-92b6-edafaa23c0dc service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:57:11.567397 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-5e4e5e16-d09e-44c5-9a3f-a90348fb02f6 req-68671b98-7577-4e4f-92b6-edafaa23c0dc service nova] Creating event network-changed:d3299b4c-aecd-4e56-b98a-3e617356c0ad for instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 on hv-cinder-80403 Nov 24 18:57:11.572344 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-5e4e5e16-d09e-44c5-9a3f-a90348fb02f6 req-68671b98-7577-4e4f-92b6-edafaa23c0dc service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092643 Nov 24 18:57:11.573198 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1596/2712] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:58:39.633547 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:39.634229 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:39.640468 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:39.641055 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:39.642459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:39.643176 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:39.667482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:58:39.976766 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-b9bd0fb9-87c1-4e42-a097-ca3ac3fef247 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "DELETE /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 204 len: 0 microversion: 2.1 time: 0.347923 Nov 24 18:58:39.977356 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1597/2713] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:58:39 2021] DELETE /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:58:39.982737 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-cd896e8e-b993-4c71-9bd5-f695883c6070 req-06d500ea-5433-4398-aae1-8c83afad0f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3c637b-158c-4a17-aa93-ab4ac00f8857", "tag": "d3299b4c-aecd-4e56-b98a-3e617356c0ad"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:58:39.985445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:58:39.985445 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:58:39.992169 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-cd896e8e-b993-4c71-9bd5-f695883c6070 req-06d500ea-5433-4398-aae1-8c83afad0f67 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:39.992613 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-cd896e8e-b993-4c71-9bd5-f695883c6070 req-06d500ea-5433-4398-aae1-8c83afad0f67 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:40.004482 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-cd896e8e-b993-4c71-9bd5-f695883c6070 req-06d500ea-5433-4398-aae1-8c83afad0f67 service nova] Creating event network-changed:d3299b4c-aecd-4e56-b98a-3e617356c0ad for instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 on hv-cinder-80403 Nov 24 18:58:40.009138 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-cd896e8e-b993-4c71-9bd5-f695883c6070 req-06d500ea-5433-4398-aae1-8c83afad0f67 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030415 Nov 24 18:58:40.013784 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1598/2714] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:58:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:58:40.014577 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:40.015243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:40.022028 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:40.022475 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:40.023255 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:40.023689 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:40.162562 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:40.170922 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-f8e8dc26-8d7a-43e0-b9b6-6f0fe1f4a809 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1578 microversion: 2.1 time: 0.160059 Nov 24 18:58:40.171503 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1599/2715] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:40 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:58:41.188121 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:41.188854 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:41.195179 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:41.195633 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:41.196403 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:41.196838 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:41.329100 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:41.336402 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-18c3b603-2817-4757-8a40-a32b5bdae032 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1459 microversion: 2.1 time: 0.151900 Nov 24 18:58:41.336976 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1600/2716] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:41 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:58:42.316206 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-3a7c9fa2-7b3a-4295-a839-bd5d7a353562 req-89f9d44c-1f21-44e9-89af-5f46aa76af94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3c637b-158c-4a17-aa93-ab4ac00f8857", "name": "network-vif-deleted", "tag": "d3299b4c-aecd-4e56-b98a-3e617356c0ad"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:58:42.317871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:58:42.317871 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:58:42.324929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-3a7c9fa2-7b3a-4295-a839-bd5d7a353562 req-89f9d44c-1f21-44e9-89af-5f46aa76af94 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:42.325366 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-3a7c9fa2-7b3a-4295-a839-bd5d7a353562 req-89f9d44c-1f21-44e9-89af-5f46aa76af94 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:42.336580 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-3a7c9fa2-7b3a-4295-a839-bd5d7a353562 req-89f9d44c-1f21-44e9-89af-5f46aa76af94 service nova] Creating event network-vif-deleted:d3299b4c-aecd-4e56-b98a-3e617356c0ad for instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 on hv-cinder-80403 Nov 24 18:58:42.341616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-3a7c9fa2-7b3a-4295-a839-bd5d7a353562 req-89f9d44c-1f21-44e9-89af-5f46aa76af94 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Nov 24 18:58:42.342314 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1601/2717] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:58:42.354683 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:42.355384 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:42.362544 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:42.362994 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:42.363780 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:42.364218 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:42.427275 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:42.437214 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fc8d28fe-27ab-47c2-9277-ad7d6cce22fd tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1391 microversion: 2.1 time: 0.086364 Nov 24 18:58:42.439133 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1602/2718] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:42 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1391 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:58:43.454761 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:43.456806 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:43.463067 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:43.463459 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:43.464231 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:43.464668 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:43.493419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:43.493916 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:43.494368 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.objects.instance [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lazy-loading 'fault' on Instance uuid 7b3c637b-158c-4a17-aa93-ab4ac00f8857 {{(pid=116730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 18:58:43.533540 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:43.540505 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-c719b5af-f056-4913-a896-0b1080c2cfa9 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 200 len: 1185 microversion: 2.1 time: 0.089373 Nov 24 18:58:43.541105 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1603/2719] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:43 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 1185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:58:44.558726 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:44.559330 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 7b3c637b-158c-4a17-aa93-ab4ac00f8857] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:44.565845 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:44.566289 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:44.567053 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:44.567483 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:44.580788 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] HTTP exception thrown: Instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 could not be found. Nov 24 18:58:44.581446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Returning 404 to user: Instance 7b3c637b-158c-4a17-aa93-ab4ac00f8857 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:58:44.582286 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9bf7cf9a-abe0-4872-9e5f-91262deb17b2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857" status: 404 len: 111 microversion: 2.1 time: 0.027222 Nov 24 18:58:44.582815 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1604/2720] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:44 2021] GET /compute/v2.1/servers/7b3c637b-158c-4a17-aa93-ab4ac00f8857 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:58:47.898419 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:47.898999 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:47.904960 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:47.905485 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:47.906351 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:47.906859 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:47.932264 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Going to try to terminate instance {{(pid=116730) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 18:58:48.196487 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-61ac0be6-797d-4679-ad19-afad17690b9f tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 204 len: 0 microversion: 2.1 time: 0.301620 Nov 24 18:58:48.197103 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1605/2721] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:58:47 2021] DELETE /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:58:48.202200 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-398ef39a-42da-48b6-ac7e-96ccd46530e8 req-1173f511-bff0-41c1-946c-0a131e0d495c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9628b4d0-d484-4637-a5a3-3792868763d2", "tag": "f9e64a00-6792-4095-bc8e-7e6183370793"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:58:48.203664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:58:48.203664 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:58:48.210657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-398ef39a-42da-48b6-ac7e-96ccd46530e8 req-1173f511-bff0-41c1-946c-0a131e0d495c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:48.211097 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-398ef39a-42da-48b6-ac7e-96ccd46530e8 req-1173f511-bff0-41c1-946c-0a131e0d495c service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:48.224024 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-398ef39a-42da-48b6-ac7e-96ccd46530e8 req-1173f511-bff0-41c1-946c-0a131e0d495c service nova] Creating event network-changed:f9e64a00-6792-4095-bc8e-7e6183370793 for instance 9628b4d0-d484-4637-a5a3-3792868763d2 on hv-cinder-80403 Nov 24 18:58:48.228775 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-398ef39a-42da-48b6-ac7e-96ccd46530e8 req-1173f511-bff0-41c1-946c-0a131e0d495c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030339 Nov 24 18:58:48.229376 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1606/2722] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:58:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:58:48.235770 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:48.237833 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:48.244657 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:48.245161 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:48.245995 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:48.246413 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:48.388244 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:48.397257 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-38bafb55-6d53-4d89-a077-d583994d7446 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1579 microversion: 2.1 time: 0.165355 Nov 24 18:58:48.402434 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1607/2723] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:48 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:58:49.414517 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:49.415193 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:49.421444 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:49.421933 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:49.422712 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:49.423153 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:49.560924 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:49.568792 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3faf91b8-13a7-47cf-9f21-1102952fdd2c tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1460 microversion: 2.1 time: 0.157945 Nov 24 18:58:49.569358 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1608/2724] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:49 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:58:50.243929 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [req-98a011af-f2ec-4ca6-b07b-5060cbce9ac7 req-5d5e9b5f-f83a-4323-9727-6056efd08f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9628b4d0-d484-4637-a5a3-3792868763d2", "name": "network-vif-deleted", "tag": "f9e64a00-6792-4095-bc8e-7e6183370793"}]} {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:58:50.245543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:58:50.245543 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: warnings.warn(msg) Nov 24 18:58:50.252616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-98a011af-f2ec-4ca6-b07b-5060cbce9ac7 req-5d5e9b5f-f83a-4323-9727-6056efd08f67 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:50.253056 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [req-98a011af-f2ec-4ca6-b07b-5060cbce9ac7 req-5d5e9b5f-f83a-4323-9727-6056efd08f67 service nova] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:50.264155 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.compute.server_external_events [req-98a011af-f2ec-4ca6-b07b-5060cbce9ac7 req-5d5e9b5f-f83a-4323-9727-6056efd08f67 service nova] Creating event network-vif-deleted:f9e64a00-6792-4095-bc8e-7e6183370793 for instance 9628b4d0-d484-4637-a5a3-3792868763d2 on hv-cinder-80403 Nov 24 18:58:50.270243 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [req-98a011af-f2ec-4ca6-b07b-5060cbce9ac7 req-5d5e9b5f-f83a-4323-9727-6056efd08f67 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029138 Nov 24 18:58:50.270785 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1609/2725] 10.222.0.53 () {64 vars in 1317 bytes} [Wed Nov 24 18:58:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:58:50.586884 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:50.591111 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:50.594227 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:50.594674 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:50.595449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:50.595876 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:50.658988 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.policy [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23035183c14f453199236832012db067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bf4bc532e74d50a5a78bd2c5fc31cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116730) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:58:50.666191 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-6ca2fec9-825f-46d3-b5ab-14239f59f706 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 200 len: 1226 microversion: 2.1 time: 0.083312 Nov 24 18:58:50.666757 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1610/2726] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:50 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:58:51.683098 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:51.683729 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9628b4d0-d484-4637-a5a3-3792868763d2] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:51.689927 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:51.690367 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:51.691190 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:51.691616 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:51.704285 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] HTTP exception thrown: Instance 9628b4d0-d484-4637-a5a3-3792868763d2 could not be found. Nov 24 18:58:51.704856 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Returning 404 to user: Instance 9628b4d0-d484-4637-a5a3-3792868763d2 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:58:51.705656 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-5129219e-8df0-4f3a-bf22-4cf2d68af53e tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2" status: 404 len: 111 microversion: 2.1 time: 0.026287 Nov 24 18:58:51.706236 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1611/2727] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:51 2021] GET /compute/v2.1/servers/9628b4d0-d484-4637-a5a3-3792868763d2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:58:52.201301 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:52.201865 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:52.208228 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:52.208709 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:52.209480 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:52.209944 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:52.223347 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] HTTP exception thrown: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. Nov 24 18:58:52.223947 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Returning 404 to user: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:58:52.224754 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-3af01c28-7938-4729-a827-36c49f794fd2 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 404 len: 111 microversion: 2.1 time: 0.027185 Nov 24 18:58:52.225274 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1612/2728] 10.222.0.53 () {58 vars in 1238 bytes} [Wed Nov 24 18:58:52 2021] DELETE /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:58:52.232586 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:52.233178 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.compute.api [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] [instance: 9316c084-364a-44c3-a9bd-083641f6c147] Fetching instance by UUID {{(pid=116730) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 18:58:52.238808 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:52.239251 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:52.240014 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 18:58:52.240449 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG oslo_concurrency.lockutils [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Lock "0c980a57-af87-4946-abcd-63304ecc43eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 18:58:52.253005 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.wsgi [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] HTTP exception thrown: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. Nov 24 18:58:52.253628 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Returning 404 to user: Instance 9316c084-364a-44c3-a9bd-083641f6c147 could not be found. {{(pid=116730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 18:58:52.254659 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-fb06c9fc-97d8-4659-93a2-4c7be9f26690 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147" status: 404 len: 111 microversion: 2.1 time: 0.025297 Nov 24 18:58:52.255164 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1613/2729] 10.222.0.53 () {58 vars in 1235 bytes} [Wed Nov 24 18:58:52 2021] GET /compute/v2.1/servers/9316c084-364a-44c3-a9bd-083641f6c147 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:58:53.695436 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: DEBUG nova.api.openstack.wsgi [None req-9a7e3fea-3995-4ca9-84e5-493cef541399 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] Calling method '.version_select at 0x7f8ba8584940>' {{(pid=116730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:58:53.772446 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO nova.api.openstack.requestlog [None req-9a7e3fea-3995-4ca9-84e5-493cef541399 tempest-TestVolumeBootPattern-1937140400 tempest-TestVolumeBootPattern-1937140400-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866583076" status: 202 len: 0 microversion: 2.1 time: 0.080684 Nov 24 18:58:53.773045 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: [pid: 116730|app: 0|req: 1614/2730] 10.222.0.53 () {58 vars in 1262 bytes} [Wed Nov 24 18:58:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866583076 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:59:17.213228 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:59:17.214702 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 18:59:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 19:00:29.725318 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:00:29.725996 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 19:00:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 19:00:55.177724 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:00:55.178331 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 19:00:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 19:02:10.510556 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:02:10.511273 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 19:02:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 19:02:37.232074 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:02:37.232669 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 19:02:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 19:03:49.742137 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:03:49.742788 dv-cinder-804035-22-iscsi devstack@n-api.service[116731]: Wed Nov 24 19:03:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.53) !!! Nov 24 19:04:10.617309 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 19:04:10.618405 dv-cinder-804035-22-iscsi devstack@n-api.service[116730]: Wed Nov 24 19:04:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!